[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:20:24 dist-test-slave-njxd krb5kdc[19096](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:20:24 dist-test-slave-njxd krb5kdc[19096](info): set up 2 sockets
Aug 12 00:20:24 dist-test-slave-njxd krb5kdc[19096](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 00:20:25.801362 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.007s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:20:25 dist-test-slave-njxd krb5kdc[19096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:20:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:20:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:20:26.029431 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:46277
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:46277
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:26.388001 19111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:26.388347 19111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:26.388489 19111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:26.397616 19111 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:20:26.397796 19111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:26.397886 19111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:26.397992 19111 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:20:26.398082 19111 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:20:26.408820 19111 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:46277
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:46277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:26.410403 19111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:26.411887 19111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:26.425282 19117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:26.425350 19120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:26.425318 19118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:26.426335 19111 server_base.cc:1034] running on GCE node
I20260812 00:20:26.427325 19111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:26.429098 19111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:26.430365 19111 hybrid_clock.cc:648] HybridClock initialized: now 1786494026430339 us; error 90 us; skew 500 ppm
I20260812 00:20:26.430785 19111 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:26 dist-test-slave-njxd krb5kdc[19096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494026, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:26.434686 19111 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:20:26.436501 19111 webserver.cc:460] Webserver started at http://127.18.163.254:32935/ using document root <none> and password file <none>
I20260812 00:20:26.437307 19111 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:26.437474 19111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:26.437883 19111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:26.441535 19111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "99ff5efa27a84681b29fb60b2850b614"
format_stamp: "Formatted at 2026-08-12 00:20:26 on dist-test-slave-njxd"
server_key: "e620588640914b76a0749cf31040d5a1"
server_key_iv: "83340e81df85de1e8252c171c92ca108"
server_key_version: "encryptionkey@0"
I20260812 00:20:26.442589 19111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "99ff5efa27a84681b29fb60b2850b614"
format_stamp: "Formatted at 2026-08-12 00:20:26 on dist-test-slave-njxd"
server_key: "e620588640914b76a0749cf31040d5a1"
server_key_iv: "83340e81df85de1e8252c171c92ca108"
server_key_version: "encryptionkey@0"
I20260812 00:20:26.449210 19111 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260812 00:20:26.453855 19127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:26.455520 19111 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:20:26.455749 19111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "99ff5efa27a84681b29fb60b2850b614"
format_stamp: "Formatted at 2026-08-12 00:20:26 on dist-test-slave-njxd"
server_key: "e620588640914b76a0749cf31040d5a1"
server_key_iv: "83340e81df85de1e8252c171c92ca108"
server_key_version: "encryptionkey@0"
I20260812 00:20:26.455987 19111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:26.479417 19111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:26.486106 19111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:26.486493 19111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:26.507575 19111 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:46277
I20260812 00:20:26.507611 19182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:46277 every 8 connection(s)
I20260812 00:20:26.509109 19111 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:20:26.513384 19183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:26.514881 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 19111
I20260812 00:20:26.515226 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:20:26.517455 19087 external_mini_cluster.cc:1428] Setting key cc0a72ac6abb615c8a5eb6d93a6aff8b
I20260812 00:20:26.526355 19183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614: Bootstrap starting.
I20260812 00:20:26.529989 19183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:26.531237 19183 log.cc:824] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614: Log is configured to *not* fsync() on all Append() calls
I20260812 00:20:26.534823 19183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614: No bootstrap required, opened a new log
I20260812 00:20:26.543398 19183 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ff5efa27a84681b29fb60b2850b614" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46277 } }
I20260812 00:20:26.543884 19183 raft_consensus.cc:374] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:26.544037 19183 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ff5efa27a84681b29fb60b2850b614, State: Initialized, Role: FOLLOWER
I20260812 00:20:26.544723 19183 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ff5efa27a84681b29fb60b2850b614" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46277 } }
I20260812 00:20:26.545011 19183 raft_consensus.cc:388] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:20:26.545171 19183 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:20:26.545361 19183 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:26.547789 19183 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ff5efa27a84681b29fb60b2850b614" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46277 } }
I20260812 00:20:26.548405 19183 leader_election.cc:302] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99ff5efa27a84681b29fb60b2850b614; no voters:
Aug 12 00:20:26 dist-test-slave-njxd krb5kdc[19096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:26.549187 19183 leader_election.cc:288] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:20:26.549319 19188 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:20:26.550735 19188 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [term 1 LEADER]: Becoming Leader. State: Replica: 99ff5efa27a84681b29fb60b2850b614, State: Running, Role: LEADER
I20260812 00:20:26.551465 19188 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ff5efa27a84681b29fb60b2850b614" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46277 } }
I20260812 00:20:26.552063 19183 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:20:26.555310 19191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99ff5efa27a84681b29fb60b2850b614. Latest consensus state: current_term: 1 leader_uuid: "99ff5efa27a84681b29fb60b2850b614" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ff5efa27a84681b29fb60b2850b614" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46277 } } }
I20260812 00:20:26.555739 19191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [sys.catalog]: This master's current role is: LEADER
I20260812 00:20:26.556411 19189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99ff5efa27a84681b29fb60b2850b614" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ff5efa27a84681b29fb60b2850b614" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46277 } } }
I20260812 00:20:26.556756 19189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614 [sys.catalog]: This master's current role is: LEADER
I20260812 00:20:26.566731 19195 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:20:26.567950 19185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:26.522239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58462 (local address 127.18.163.254:46277)
0812 00:20:26.523302 (+ 1063us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:26.523326 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:26.524463 (+ 1137us) server_negotiation.cc:407] Connection header received
0812 00:20:26.534561 (+ 10098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:26.534588 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:26.535099 (+ 511us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:26.535578 (+ 479us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:26.539294 (+ 3716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:26.540778 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:26.542838 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:26.543576 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:26.543817 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:26.551135 (+ 7318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:26.551148 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:26.551164 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:26.551219 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:26.556446 (+ 5227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:26.558619 (+ 2173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:26.558633 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:26.558646 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:26.558979 (+ 333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:26.559830 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:26.559838 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:26.559844 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:26.561051 (+ 1207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:26.561538 (+ 487us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:26.565758 (+ 4220us) server_negotiation.cc:299] Negotiation successful
0812 00:20:26.566349 (+ 591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":438,"threads_started":1}
I20260812 00:20:26.573778 19195 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:20:26.584972 19195 catalog_manager.cc:1347] Generated new cluster ID: 88d6ec828c9a42efa51a452e18097a33
I20260812 00:20:26.585132 19195 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:20:26.603818 19195 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:20:26.605506 19195 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:20:26.612609 19195 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 99ff5efa27a84681b29fb60b2850b614: Generated new TSK 0
I20260812 00:20:26.613826 19195 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:20:26.681413 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:46277
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:27.070420 19213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:27.070732 19213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:27.070902 19213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:27.079986 19213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:27.080132 19213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:27.080360 19213 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:20:27.091110 19213 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:46277
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:27.092636 19213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:27.094290 19213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:27.109256 19218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:27.109227 19220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:27.109190 19222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:27.110049 19213 server_base.cc:1034] running on GCE node
I20260812 00:20:27.110787 19213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:27.111976 19213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:27.113240 19213 hybrid_clock.cc:648] HybridClock initialized: now 1786494027113187 us; error 71 us; skew 500 ppm
I20260812 00:20:27.113718 19213 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:27 dist-test-slave-njxd krb5kdc[19096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494027, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:27.117311 19213 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:20:27.119184 19213 webserver.cc:460] Webserver started at http://127.18.163.193:41055/ using document root <none> and password file <none>
I20260812 00:20:27.120055 19213 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:27.120236 19213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:27.120631 19213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:27.124188 19213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "ecd9cdbf29064b9698d0521f4e76e933"
format_stamp: "Formatted at 2026-08-12 00:20:27 on dist-test-slave-njxd"
server_key: "37beff2e18aa4fb69328eb85499449c6"
server_key_iv: "aa31eeab3343fca05735c1ae455b0f7b"
server_key_version: "encryptionkey@0"
I20260812 00:20:27.125144 19213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "ecd9cdbf29064b9698d0521f4e76e933"
format_stamp: "Formatted at 2026-08-12 00:20:27 on dist-test-slave-njxd"
server_key: "37beff2e18aa4fb69328eb85499449c6"
server_key_iv: "aa31eeab3343fca05735c1ae455b0f7b"
server_key_version: "encryptionkey@0"
I20260812 00:20:27.131632 19213 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260812 00:20:27.135725 19229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:27.137418 19213 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:20:27.137682 19213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "ecd9cdbf29064b9698d0521f4e76e933"
format_stamp: "Formatted at 2026-08-12 00:20:27 on dist-test-slave-njxd"
server_key: "37beff2e18aa4fb69328eb85499449c6"
server_key_iv: "aa31eeab3343fca05735c1ae455b0f7b"
server_key_version: "encryptionkey@0"
I20260812 00:20:27.137933 19213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:27.165278 19213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:27.171429 19213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:27.171763 19213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:27.172888 19213 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:20:27.174468 19213 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:27.174569 19213 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:27.174743 19213 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:27.174813 19213 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:27.210283 19213 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:44893
I20260812 00:20:27.210335 19357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:44893 every 8 connection(s)
I20260812 00:20:27.211730 19213 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:20:27.219095 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 19213
I20260812 00:20:27.219360 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:20:27.220042 19087 external_mini_cluster.cc:1428] Setting key 1d94d5043280659cb902c1af63be63ec
Aug 12 00:20:27 dist-test-slave-njxd krb5kdc[19096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494027, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:27.235832 19360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:27.214758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:59179 (local address 127.18.163.254:46277)
0812 00:20:27.215300 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:27.215304 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:27.216265 (+ 961us) server_negotiation.cc:407] Connection header received
0812 00:20:27.218392 (+ 2127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:27.218400 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:27.218509 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:27.218657 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:27.220630 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:27.221649 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:27.223683 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:27.224483 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:27.224672 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:27.228600 (+ 3928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:27.228611 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:27.228619 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:27.228674 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:27.231896 (+ 3222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:27.233071 (+ 1175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:27.233076 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:27.233079 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:27.233219 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:27.233830 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:27.233834 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:27.233836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:27.234126 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:27.234248 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:27.235341 (+ 1093us) server_negotiation.cc:299] Negotiation successful
0812 00:20:27.235551 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":302,"threads_started":1}
I20260812 00:20:27.237618 19362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:27.215302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46277 (local address 127.18.163.193:59179)
0812 00:20:27.216077 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:27.216129 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:27.218071 (+ 1942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:27.218947 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:27.218956 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:27.219670 (+ 714us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:27.220410 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:27.220434 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:27.221847 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:27.221854 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:27.223467 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:27.223483 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:27.224759 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:27.224764 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:27.224996 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:27.225837 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:27.225863 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:27.228295 (+ 2432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:27.232087 (+ 3792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:27.232102 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:27.232132 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:27.232917 (+ 785us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:27.233347 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:27.233355 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:27.233361 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:27.233702 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:27.234269 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:27.234282 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:27.234829 (+ 547us) client_negotiation.cc:769] Sending connection context
0812 00:20:27.235182 (+ 353us) client_negotiation.cc:240] Negotiation successful
0812 00:20:27.235911 (+ 729us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":291,"threads_started":1}
I20260812 00:20:27.239494 19358 heartbeater.cc:347] Connected to a master server at 127.18.163.254:46277
I20260812 00:20:27.239904 19358 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:27.241022 19358 heartbeater.cc:511] Master 127.18.163.254:46277 requested a full tablet report, sending...
I20260812 00:20:27.244082 19145 ts_manager.cc:194] Registered new tserver with Master: ecd9cdbf29064b9698d0521f4e76e933 (127.18.163.193:44893)
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
I20260812 00:20:27.246021 19145 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:59179
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:20:27.273190 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:46277
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:27.646358 19365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:27.646682 19365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:27.646790 19365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:27.654772 19365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:27.654907 19365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:27.655030 19365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:20:27.665514 19365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:46277
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:27.667001 19365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:27.668514 19365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:27.683141 19371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:27.683054 19372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:27.683101 19376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:27.684161 19365 server_base.cc:1034] running on GCE node
I20260812 00:20:27.684914 19365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:27.686086 19365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:27.687318 19365 hybrid_clock.cc:648] HybridClock initialized: now 1786494027687266 us; error 44 us; skew 500 ppm
I20260812 00:20:27.687681 19365 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:27 dist-test-slave-njxd krb5kdc[19096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494027, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:27.691248 19365 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:20:27.693019 19365 webserver.cc:460] Webserver started at http://127.18.163.194:46033/ using document root <none> and password file <none>
I20260812 00:20:27.693894 19365 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:27.694053 19365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:27.694434 19365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:27.697827 19365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "f285bb2cd96742bea225d8e065e3321a"
format_stamp: "Formatted at 2026-08-12 00:20:27 on dist-test-slave-njxd"
server_key: "a79182bf9c2cf6b2d31d26aa3f087062"
server_key_iv: "a54e1051555b8ac0b4811d149b682b8e"
server_key_version: "encryptionkey@0"
I20260812 00:20:27.698704 19365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "f285bb2cd96742bea225d8e065e3321a"
format_stamp: "Formatted at 2026-08-12 00:20:27 on dist-test-slave-njxd"
server_key: "a79182bf9c2cf6b2d31d26aa3f087062"
server_key_iv: "a54e1051555b8ac0b4811d149b682b8e"
server_key_version: "encryptionkey@0"
I20260812 00:20:27.704533 19365 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 00:20:27.708331 19384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:27.710043 19365 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:20:27.710282 19365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "f285bb2cd96742bea225d8e065e3321a"
format_stamp: "Formatted at 2026-08-12 00:20:27 on dist-test-slave-njxd"
server_key: "a79182bf9c2cf6b2d31d26aa3f087062"
server_key_iv: "a54e1051555b8ac0b4811d149b682b8e"
server_key_version: "encryptionkey@0"
I20260812 00:20:27.710561 19365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:27.735038 19365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:27.740104 19365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:27.740409 19365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:27.741662 19365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:20:27.743304 19365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:27.743418 19365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:27.743582 19365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:27.743665 19365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:27.780030 19365 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:40715
I20260812 00:20:27.780123 19511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:40715 every 8 connection(s)
I20260812 00:20:27.781447 19365 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:20:27.787446 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 19365
I20260812 00:20:27.787688 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:20:27.788256 19087 external_mini_cluster.cc:1428] Setting key 8dbba895b606dc98f9370c8015225a48
Aug 12 00:20:27 dist-test-slave-njxd krb5kdc[19096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494027, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:27.808254 19514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:27.784183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:34853 (local address 127.18.163.254:46277)
0812 00:20:27.784702 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:27.784707 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:27.785756 (+ 1049us) server_negotiation.cc:407] Connection header received
0812 00:20:27.788262 (+ 2506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:27.788268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:27.788385 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:27.788498 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:27.790665 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:27.791437 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:27.794258 (+ 2821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:27.794723 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:27.794828 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:27.800065 (+ 5237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:27.800071 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:27.800075 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:27.800140 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:27.804093 (+ 3953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:27.805097 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:27.805106 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:27.805113 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:27.805308 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:27.805896 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:27.805904 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:27.805910 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:27.806418 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:27.806591 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:27.807392 (+ 801us) server_negotiation.cc:299] Negotiation successful
0812 00:20:27.807713 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":287,"threads_started":1}
I20260812 00:20:27.809119 19515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:27.784757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46277 (local address 127.18.163.194:34853)
0812 00:20:27.785521 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:27.785562 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:27.787887 (+ 2325us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:27.788833 (+ 946us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:27.788848 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:27.789517 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:27.790474 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:27.790503 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:27.791622 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:27.791630 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:27.794065 (+ 2435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:27.794087 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:27.794996 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:27.795008 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:27.795382 (+ 374us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:27.796251 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:27.796292 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:27.799684 (+ 3392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:27.804324 (+ 4640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:27.804333 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:27.804350 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:27.804910 (+ 560us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:27.805448 (+ 538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:27.805451 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:27.805453 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:27.805755 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:27.806563 (+ 808us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:27.806570 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:27.806959 (+ 389us) client_negotiation.cc:769] Sending connection context
0812 00:20:27.807208 (+ 249us) client_negotiation.cc:240] Negotiation successful
0812 00:20:27.807672 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":298,"threads_started":1}
I20260812 00:20:27.810990 19512 heartbeater.cc:347] Connected to a master server at 127.18.163.254:46277
I20260812 00:20:27.811403 19512 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:27.812475 19512 heartbeater.cc:511] Master 127.18.163.254:46277 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
I20260812 00:20:27.814486 19145 ts_manager.cc:194] Registered new tserver with Master: f285bb2cd96742bea225d8e065e3321a (127.18.163.194:40715)
I20260812 00:20:27.815608 19145 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:34853
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
I20260812 00:20:27.843489 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:46277
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:28.214259 19518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:28.214686 19518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:28.214885 19518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:28.223508 19518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:28.223629 19518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:28.223759 19518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:20:28.234809 19518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:46277
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:28.236318 19518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:28.237950 19518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:20:28.249898 19358 heartbeater.cc:503] Master 127.18.163.254:46277 was elected leader, sending a full tablet report...
W20260812 00:20:28.253505 19523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:28.253425 19524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:28.253470 19527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:28.254534 19518 server_base.cc:1034] running on GCE node
I20260812 00:20:28.255352 19518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:28.256461 19518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:28.257681 19518 hybrid_clock.cc:648] HybridClock initialized: now 1786494028257620 us; error 58 us; skew 500 ppm
I20260812 00:20:28.258040 19518 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:28 dist-test-slave-njxd krb5kdc[19096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494028, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:28.261924 19518 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:20:28.263770 19518 webserver.cc:460] Webserver started at http://127.18.163.195:43815/ using document root <none> and password file <none>
I20260812 00:20:28.264575 19518 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:28.264742 19518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:28.265105 19518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:28.268731 19518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "11ba35468a4344b48c51d915aea96116"
format_stamp: "Formatted at 2026-08-12 00:20:28 on dist-test-slave-njxd"
server_key: "32db8ffbbac2f4a7a4fad6373a0f01c3"
server_key_iv: "63d3820e367be3c735cf75ad22d24154"
server_key_version: "encryptionkey@0"
I20260812 00:20:28.269797 19518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "11ba35468a4344b48c51d915aea96116"
format_stamp: "Formatted at 2026-08-12 00:20:28 on dist-test-slave-njxd"
server_key: "32db8ffbbac2f4a7a4fad6373a0f01c3"
server_key_iv: "63d3820e367be3c735cf75ad22d24154"
server_key_version: "encryptionkey@0"
I20260812 00:20:28.276309 19518 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:20:28.280855 19534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:28.282589 19518 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:20:28.282835 19518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "11ba35468a4344b48c51d915aea96116"
format_stamp: "Formatted at 2026-08-12 00:20:28 on dist-test-slave-njxd"
server_key: "32db8ffbbac2f4a7a4fad6373a0f01c3"
server_key_iv: "63d3820e367be3c735cf75ad22d24154"
server_key_version: "encryptionkey@0"
I20260812 00:20:28.283099 19518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:28.301016 19518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:28.305944 19518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:28.306272 19518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:28.307363 19518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:20:28.308786 19518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:28.308862 19518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:28.308954 19518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:28.309000 19518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:28.357415 19518 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:36255
I20260812 00:20:28.357481 19664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:36255 every 8 connection(s)
I20260812 00:20:28.358937 19518 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:20:28.367974 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 19518
I20260812 00:20:28.368247 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:20:28.368954 19087 external_mini_cluster.cc:1428] Setting key 18f1a5d190e8de8d8ed0fc1d10252be9
Aug 12 00:20:28 dist-test-slave-njxd krb5kdc[19096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494028, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:28.391899 19667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:28.362292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:37247 (local address 127.18.163.254:46277)
0812 00:20:28.370854 (+ 8562us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:28.370863 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:28.370886 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:20:28.370960 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:28.370968 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:28.371099 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:28.371244 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:28.373831 (+ 2587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:28.374793 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:28.377740 (+ 2947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:28.378150 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:28.378262 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:28.383169 (+ 4907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:28.383179 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:28.383187 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:28.383247 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:28.387933 (+ 4686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:28.388875 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:28.388884 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:28.388891 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:28.389071 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:28.389535 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:28.389543 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:28.389549 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:28.390039 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:28.390227 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:28.390987 (+ 760us) server_negotiation.cc:299] Negotiation successful
0812 00:20:28.391293 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8389,"thread_start_us":8205,"threads_started":1}
I20260812 00:20:28.392537 19668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:28.363142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46277 (local address 127.18.163.195:37247)
0812 00:20:28.366454 (+ 3312us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:28.366524 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:28.369902 (+ 3378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:28.371608 (+ 1706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:28.371622 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:28.372568 (+ 946us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:28.373543 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:28.373610 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:28.374989 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:28.374997 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:28.377528 (+ 2531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:28.377551 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:28.378431 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:28.378441 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:28.378865 (+ 424us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:28.379705 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:28.379745 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:28.382881 (+ 3136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:28.388098 (+ 5217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:28.388105 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:28.388120 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:28.388721 (+ 601us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:28.389192 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:28.389201 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:28.389204 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:28.389413 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:28.390175 (+ 762us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:28.390181 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:28.390566 (+ 385us) client_negotiation.cc:769] Sending connection context
0812 00:20:28.390816 (+ 250us) client_negotiation.cc:240] Negotiation successful
0812 00:20:28.391264 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2843,"thread_start_us":2538,"threads_started":1}
I20260812 00:20:28.394207 19665 heartbeater.cc:347] Connected to a master server at 127.18.163.254:46277
I20260812 00:20:28.394644 19665 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:28.395818 19665 heartbeater.cc:511] Master 127.18.163.254:46277 requested a full tablet report, sending...
I20260812 00:20:28.397987 19145 ts_manager.cc:194] Registered new tserver with Master: 11ba35468a4344b48c51d915aea96116 (127.18.163.195:36255)
I20260812 00:20:28.399106 19145 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:37247
I20260812 00:20:28.399806 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:20:28 dist-test-slave-njxd krb5kdc[19096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494028, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:20:28 dist-test-slave-njxd krb5kdc[19096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494028, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:20:28.459625 19673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:28.441082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33840 (local address 127.18.163.193:44893)
0812 00:20:28.441999 (+ 917us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:28.442008 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:28.442036 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:20:28.442110 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:28.442118 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:28.442445 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:28.442656 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:28.444248 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:28.445319 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:28.446771 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:28.447391 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:28.447545 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:28.452445 (+ 4900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:28.452461 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:28.452478 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:28.452520 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:28.455945 (+ 3425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:28.457003 (+ 1058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:28.457010 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:28.457013 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:28.457151 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:28.457720 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:28.457723 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:28.457725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:28.458096 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:28.458356 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:28.458789 (+ 433us) server_negotiation.cc:299] Negotiation successful
0812 00:20:28.459024 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":720,"thread_start_us":494,"threads_started":1}
W20260812 00:20:28.461143 19263 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33840
Aug 12 00:20:28 dist-test-slave-njxd krb5kdc[19096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:20:28 dist-test-slave-njxd krb5kdc[19096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:20:28.533785 19673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:28.514963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33848 (local address 127.18.163.193:44893)
0812 00:20:28.515224 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:28.515231 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:28.515953 (+ 722us) server_negotiation.cc:407] Connection header received
0812 00:20:28.516147 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:28.516156 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:28.516311 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:28.516446 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:28.518360 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:28.519666 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:28.520972 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:28.521893 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:28.522055 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:28.526330 (+ 4275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:28.526341 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:28.526349 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:28.526412 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:28.530599 (+ 4187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:28.531355 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:28.531363 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:28.531369 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:28.531571 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:28.531955 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:28.531963 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:28.531969 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:28.532386 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:28.532680 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:28.532921 (+ 241us) server_negotiation.cc:299] Negotiation successful
0812 00:20:28.533227 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:20:28.535969 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 19213
I20260812 00:20:28.550192 19673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:28.537004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33860 (local address 127.18.163.193:44893)
0812 00:20:28.537231 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:28.537241 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:28.537643 (+ 402us) server_negotiation.cc:407] Connection header received
0812 00:20:28.537836 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:28.537841 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:28.537917 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:28.538019 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:28.539246 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:28.539973 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:28.541338 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:28.541854 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:28.541994 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:28.544608 (+ 2614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:28.544613 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:28.544616 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:28.544651 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:28.547423 (+ 2772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:28.548110 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:28.548116 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:28.548120 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:28.548270 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:28.548663 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:28.548668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:28.548671 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:28.548958 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:28.549228 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:28.549545 (+ 317us) server_negotiation.cc:299] Negotiation successful
0812 00:20:28.549822 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 00:20:28.551047 19353 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:20:28.638192 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 19213
I20260812 00:20:28.661885 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 19365
Aug 12 00:20:28 dist-test-slave-njxd krb5kdc[19096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
I20260812 00:20:28.679034 19680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:28.662977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36392 (local address 127.18.163.194:40715)
0812 00:20:28.663597 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:28.663605 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:28.663633 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:20:28.663703 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:28.663710 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:28.663940 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:28.664088 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:28.665355 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:28.666625 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:28.668115 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:28.668713 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:28.668821 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:28.673157 (+ 4336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:28.673174 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:28.673191 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:28.673237 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:28.676237 (+ 3000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:28.677016 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:28.677023 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:28.677025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:28.677179 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:28.677532 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:28.677535 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:28.677536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:28.677964 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:28.678213 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:28.678467 (+ 254us) server_negotiation.cc:299] Negotiation successful
0812 00:20:28.678690 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":328,"threads_started":1}
I20260812 00:20:28.680392 19506 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:20:28.765928 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 19365
I20260812 00:20:28.787405 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 19518
Aug 12 00:20:28 dist-test-slave-njxd krb5kdc[19096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:20:28.804760 19682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:28.788483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36654 (local address 127.18.163.195:36255)
0812 00:20:28.789012 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:28.789019 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:28.789051 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:20:28.789119 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:28.789126 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:28.789354 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:28.789541 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:28.790922 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:28.791948 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:28.793328 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:28.794106 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:28.794257 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:28.798795 (+ 4538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:28.798812 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:28.798829 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:28.798873 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:28.802100 (+ 3227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:28.802776 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:28.802783 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:28.802786 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:28.802924 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:28.803274 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:28.803277 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:28.803279 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:28.803681 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:28.803934 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:28.804224 (+ 290us) server_negotiation.cc:299] Negotiation successful
0812 00:20:28.804446 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":236,"threads_started":1}
I20260812 00:20:28.806294 19660 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:20:28.891780 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 19518
I20260812 00:20:28.913530 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 19111
I20260812 00:20:28.914791 19178 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:20:29.035027 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 19111
2026-08-12T00:20:29Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4442 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:20:29 dist-test-slave-njxd krb5kdc[19687](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:20:29 dist-test-slave-njxd krb5kdc[19687](info): set up 2 sockets
Aug 12 00:20:29 dist-test-slave-njxd krb5kdc[19687](info): commencing operation
krb5kdc: starting...
W20260812 00:20:30.217278 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.000s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:20:30 dist-test-slave-njxd krb5kdc[19687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:20:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:20:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:20:30.451573 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:37295
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:37333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:37295
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:30.806903 19700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:30.807322 19700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:30.807498 19700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:30.815344 19700 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:20:30.815539 19700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:30.815660 19700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:30.815763 19700 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:20:30.815853 19700 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:20:30.826596 19700 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:37333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:37295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:37295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:30.828137 19700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:30.829650 19700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:30.842705 19706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:30.842679 19707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:30.842914 19710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:30.843641 19700 server_base.cc:1034] running on GCE node
I20260812 00:20:30.844511 19700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:30.846204 19700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:30.847465 19700 hybrid_clock.cc:648] HybridClock initialized: now 1786494030847418 us; error 38 us; skew 500 ppm
I20260812 00:20:30.847864 19700 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:30 dist-test-slave-njxd krb5kdc[19687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494030, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:30.857211 19700 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:20:30.858969 19700 webserver.cc:460] Webserver started at http://127.18.163.254:36249/ using document root <none> and password file <none>
I20260812 00:20:30.859736 19700 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:30.859849 19700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:30.860150 19700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:30.863550 19700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "232e05f18ce94171b0184b7893a178c6"
format_stamp: "Formatted at 2026-08-12 00:20:30 on dist-test-slave-njxd"
server_key: "ed5c9fb32e97a7b8af34752e3bfad673"
server_key_iv: "900f11b941bcb1e57443d51dd1ed33dc"
server_key_version: "encryptionkey@0"
I20260812 00:20:30.864377 19700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "232e05f18ce94171b0184b7893a178c6"
format_stamp: "Formatted at 2026-08-12 00:20:30 on dist-test-slave-njxd"
server_key: "ed5c9fb32e97a7b8af34752e3bfad673"
server_key_iv: "900f11b941bcb1e57443d51dd1ed33dc"
server_key_version: "encryptionkey@0"
I20260812 00:20:30.870267 19700 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 00:20:30.874184 19718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:30.875764 19700 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:20:30.875977 19700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "232e05f18ce94171b0184b7893a178c6"
format_stamp: "Formatted at 2026-08-12 00:20:30 on dist-test-slave-njxd"
server_key: "ed5c9fb32e97a7b8af34752e3bfad673"
server_key_iv: "900f11b941bcb1e57443d51dd1ed33dc"
server_key_version: "encryptionkey@0"
I20260812 00:20:30.876248 19700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:30.903998 19700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:30.909265 19700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:30.909706 19700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:30.930663 19700 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:37295
I20260812 00:20:30.930670 19778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:37295 every 8 connection(s)
I20260812 00:20:30.932232 19700 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:20:30.935889 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 19700
I20260812 00:20:30.936146 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:20:30.936587 19780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:30.936851 19087 external_mini_cluster.cc:1428] Setting key c776b59904bd8d92851e5f0411d0fc59
Aug 12 00:20:30 dist-test-slave-njxd krb5kdc[19687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:30.953409 19780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6: Bootstrap starting.
I20260812 00:20:30.957398 19780 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:30.958688 19780 log.cc:824] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:20:30.962142 19780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6: No bootstrap required, opened a new log
I20260812 00:20:30.963272 19783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:30.939014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35824 (local address 127.18.163.254:37295)
0812 00:20:30.939915 (+ 901us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:30.939931 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:30.939980 (+ 49us) server_negotiation.cc:407] Connection header received
0812 00:20:30.941839 (+ 1859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:30.941866 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:30.942439 (+ 573us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:30.942837 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:30.944938 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:30.946426 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:30.948331 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:30.949294 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:30.949457 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:30.954666 (+ 5209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:30.954675 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:30.954692 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:30.954741 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:30.958251 (+ 3510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:30.959164 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:30.959172 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:30.959180 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:30.959382 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:30.959995 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:30.960001 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:30.960009 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:30.960620 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:30.960958 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:30.961553 (+ 595us) server_negotiation.cc:299] Negotiation successful
0812 00:20:30.962083 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":669,"thread_start_us":406,"threads_started":1}
I20260812 00:20:30.970674 19780 raft_consensus.cc:348] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232e05f18ce94171b0184b7893a178c6" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37295 } }
I20260812 00:20:30.971175 19780 raft_consensus.cc:374] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:30.971299 19780 raft_consensus.cc:729] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 232e05f18ce94171b0184b7893a178c6, State: Initialized, Role: FOLLOWER
I20260812 00:20:30.971964 19780 consensus_queue.cc:260] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232e05f18ce94171b0184b7893a178c6" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37295 } }
I20260812 00:20:30.972203 19780 raft_consensus.cc:388] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:20:30.972312 19780 raft_consensus.cc:482] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:20:30.972440 19780 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:30.974852 19780 raft_consensus.cc:504] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232e05f18ce94171b0184b7893a178c6" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37295 } }
I20260812 00:20:30.975374 19780 leader_election.cc:302] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 232e05f18ce94171b0184b7893a178c6; no voters:
I20260812 00:20:30.975979 19780 leader_election.cc:288] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:20:30.976166 19786 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:20:30.976962 19786 raft_consensus.cc:686] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [term 1 LEADER]: Becoming Leader. State: Replica: 232e05f18ce94171b0184b7893a178c6, State: Running, Role: LEADER
I20260812 00:20:30.977689 19786 consensus_queue.cc:237] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232e05f18ce94171b0184b7893a178c6" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37295 } }
I20260812 00:20:30.978561 19780 sys_catalog.cc:564] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:20:30.981560 19787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "232e05f18ce94171b0184b7893a178c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232e05f18ce94171b0184b7893a178c6" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37295 } } }
I20260812 00:20:30.982054 19787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:20:30.981449 19788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 232e05f18ce94171b0184b7893a178c6. Latest consensus state: current_term: 1 leader_uuid: "232e05f18ce94171b0184b7893a178c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232e05f18ce94171b0184b7893a178c6" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37295 } } }
I20260812 00:20:30.982455 19788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:20:30.984571 19796 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:20:30.990417 19796 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:20:31.000324 19796 catalog_manager.cc:1347] Generated new cluster ID: b966e34e46b443d4b4fb57bbed55c79e
I20260812 00:20:31.000480 19796 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:20:31.017472 19796 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:20:31.018946 19796 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:20:31.028784 19796 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 232e05f18ce94171b0184b7893a178c6: Generated new TSK 0
I20260812 00:20:31.029829 19796 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:20:31.093914 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37295
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:37333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:31.479090 19811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:31.479537 19811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:31.479655 19811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:31.488430 19811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:31.488569 19811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:31.488692 19811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:20:31.499158 19811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:37333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37295
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:31.500643 19811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:31.502074 19811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:31.516359 19818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:31.516428 19820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:31.516453 19817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:31.517278 19811 server_base.cc:1034] running on GCE node
I20260812 00:20:31.518038 19811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:31.519119 19811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:31.520342 19811 hybrid_clock.cc:648] HybridClock initialized: now 1786494031520278 us; error 53 us; skew 500 ppm
I20260812 00:20:31.520705 19811 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:31 dist-test-slave-njxd krb5kdc[19687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494031, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:31.524369 19811 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:20:31.526224 19811 webserver.cc:460] Webserver started at http://127.18.163.193:37805/ using document root <none> and password file <none>
I20260812 00:20:31.527029 19811 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:31.527196 19811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:31.527554 19811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:31.530930 19811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53"
format_stamp: "Formatted at 2026-08-12 00:20:31 on dist-test-slave-njxd"
server_key: "44806b71b9bafe2c4d6375d596f4cd1b"
server_key_iv: "c9227610400d4b2f10954db9adcb9b5f"
server_key_version: "encryptionkey@0"
I20260812 00:20:31.531881 19811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53"
format_stamp: "Formatted at 2026-08-12 00:20:31 on dist-test-slave-njxd"
server_key: "44806b71b9bafe2c4d6375d596f4cd1b"
server_key_iv: "c9227610400d4b2f10954db9adcb9b5f"
server_key_version: "encryptionkey@0"
I20260812 00:20:31.537982 19811 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:20:31.542171 19829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:31.543860 19811 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:20:31.544086 19811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53"
format_stamp: "Formatted at 2026-08-12 00:20:31 on dist-test-slave-njxd"
server_key: "44806b71b9bafe2c4d6375d596f4cd1b"
server_key_iv: "c9227610400d4b2f10954db9adcb9b5f"
server_key_version: "encryptionkey@0"
I20260812 00:20:31.544345 19811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:31.560148 19811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:31.565459 19811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:31.565876 19811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:31.566989 19811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:20:31.568531 19811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:31.568611 19811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:31.568704 19811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:31.568765 19811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:31.607241 19811 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:40233
I20260812 00:20:31.607286 19957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:40233 every 8 connection(s)
I20260812 00:20:31.608803 19811 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:20:31.611894 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 19811
I20260812 00:20:31.612205 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:20:31.613293 19087 external_mini_cluster.cc:1428] Setting key 6eaa415b9390d40667495fffbcdee731
Aug 12 00:20:31 dist-test-slave-njxd krb5kdc[19687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494031, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:31.632861 19960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:31.611820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:38257 (local address 127.18.163.254:37295)
0812 00:20:31.614502 (+ 2682us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:31.614509 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:31.614534 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:20:31.616059 (+ 1525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:31.616065 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:31.616157 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:31.616296 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:31.618150 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:31.619366 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:31.621089 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:31.621865 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:31.622025 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:31.626341 (+ 4316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:31.626347 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:31.626350 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:31.626390 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:31.629222 (+ 2832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:31.630231 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:31.630236 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:31.630238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:31.630380 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:31.630895 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:31.630901 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:31.630903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:31.631207 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:31.631380 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:31.632196 (+ 816us) server_negotiation.cc:299] Negotiation successful
0812 00:20:31.632459 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2553,"thread_start_us":2428,"threads_started":1}
I20260812 00:20:31.634018 19961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:31.612397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:37295 (local address 127.18.163.193:38257)
0812 00:20:31.613487 (+ 1090us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:31.613541 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:31.615703 (+ 2162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:31.616566 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:31.616576 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:31.617190 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:31.617938 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:31.617960 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:31.619556 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:31.619560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:31.620910 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:31.620924 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:31.622112 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:31.622117 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:31.622338 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:31.623103 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:31.623129 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:31.626029 (+ 2900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:31.629437 (+ 3408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:31.629449 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:31.629473 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:31.630068 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:31.630512 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:31.630518 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:31.630522 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:31.630756 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:31.631351 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:31.631360 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:31.631777 (+ 417us) client_negotiation.cc:769] Sending connection context
0812 00:20:31.632068 (+ 291us) client_negotiation.cc:240] Negotiation successful
0812 00:20:31.632686 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":685,"thread_start_us":442,"threads_started":1}
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
I20260812 00:20:31.635901 19958 heartbeater.cc:347] Connected to a master server at 127.18.163.254:37295
I20260812 00:20:31.636266 19958 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:31.637190 19958 heartbeater.cc:511] Master 127.18.163.254:37295 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
I20260812 00:20:31.639916 19740 ts_manager.cc:194] Registered new tserver with Master: 7e7b6b573abf4ebaa3a06a9ca582cd53 (127.18.163.193:40233)
I20260812 00:20:31.641454 19740 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:38257
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:20:31.666769 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37295
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:37333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:32.026870 19965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:32.027173 19965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:32.027354 19965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:32.035207 19965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:32.035339 19965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:32.035550 19965 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:20:32.046275 19965 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:37333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37295
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:32.047664 19965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:32.049213 19965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:32.063373 19971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:32.063369 19972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:32.063992 19974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:32.064705 19965 server_base.cc:1034] running on GCE node
I20260812 00:20:32.065380 19965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:32.066470 19965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:32.067714 19965 hybrid_clock.cc:648] HybridClock initialized: now 1786494032067660 us; error 49 us; skew 500 ppm
I20260812 00:20:32.068061 19965 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:32 dist-test-slave-njxd krb5kdc[19687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494032, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:32.071606 19965 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:20:32.073181 19965 webserver.cc:460] Webserver started at http://127.18.163.194:37603/ using document root <none> and password file <none>
I20260812 00:20:32.074057 19965 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:32.074225 19965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:32.074600 19965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:32.078025 19965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "81f3fa86c60645cb8e4971ac6fa59f9e"
format_stamp: "Formatted at 2026-08-12 00:20:32 on dist-test-slave-njxd"
server_key: "ca14e77a2284fef6bd779e26a69242e3"
server_key_iv: "d2bd6462c60d668d9f6ea77f0d069de6"
server_key_version: "encryptionkey@0"
I20260812 00:20:32.078996 19965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "81f3fa86c60645cb8e4971ac6fa59f9e"
format_stamp: "Formatted at 2026-08-12 00:20:32 on dist-test-slave-njxd"
server_key: "ca14e77a2284fef6bd779e26a69242e3"
server_key_iv: "d2bd6462c60d668d9f6ea77f0d069de6"
server_key_version: "encryptionkey@0"
I20260812 00:20:32.084825 19965 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 00:20:32.088611 19982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:32.090147 19965 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:20:32.090341 19965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "81f3fa86c60645cb8e4971ac6fa59f9e"
format_stamp: "Formatted at 2026-08-12 00:20:32 on dist-test-slave-njxd"
server_key: "ca14e77a2284fef6bd779e26a69242e3"
server_key_iv: "d2bd6462c60d668d9f6ea77f0d069de6"
server_key_version: "encryptionkey@0"
I20260812 00:20:32.090561 19965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:32.103142 19965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:32.107932 19965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:32.108292 19965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:32.109375 19965 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:20:32.110994 19965 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:32.111100 19965 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:32.111254 19965 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:32.111327 19965 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:32.147481 19965 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:41531
I20260812 00:20:32.147523 20108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:41531 every 8 connection(s)
I20260812 00:20:32.149001 19965 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:20:32.150578 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 19965
I20260812 00:20:32.150790 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:20:32.151305 19087 external_mini_cluster.cc:1428] Setting key e03ecd5008aed4dc975db40c8cb868c9
Aug 12 00:20:32 dist-test-slave-njxd krb5kdc[19687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494032, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:32.176216 20112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:32.152087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:52059 (local address 127.18.163.254:37295)
0812 00:20:32.153955 (+ 1868us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:32.153965 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:32.154821 (+ 856us) server_negotiation.cc:407] Connection header received
0812 00:20:32.156870 (+ 2049us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:32.156879 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:32.156987 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:32.157127 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:32.158910 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.160112 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.162151 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.162615 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.162725 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:32.167085 (+ 4360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:32.167095 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:32.167102 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:32.167156 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:32.171288 (+ 4132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:32.172726 (+ 1438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:32.172734 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:32.172739 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:32.172993 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:32.173567 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:32.173595 (+ 28us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:32.173599 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:32.174079 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:32.174281 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:32.175389 (+ 1108us) server_negotiation.cc:299] Negotiation successful
0812 00:20:32.175700 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1684,"thread_start_us":1529,"threads_started":1}
I20260812 00:20:32.177634 20113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:32.152712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:37295 (local address 127.18.163.194:52059)
0812 00:20:32.154612 (+ 1900us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:32.154676 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:32.156539 (+ 1863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:32.157374 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:32.157383 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:32.158056 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:32.158699 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:32.158720 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.160290 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.160294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:32.161955 (+ 1661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:32.161984 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.162888 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.162893 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:32.163112 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:32.163895 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:32.163920 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:32.166747 (+ 2827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:32.171533 (+ 4786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:32.171547 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:32.171570 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:32.172379 (+ 809us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:32.173157 (+ 778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:32.173163 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:32.173167 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:32.173415 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:32.174253 (+ 838us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:32.174271 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:32.174817 (+ 546us) client_negotiation.cc:769] Sending connection context
0812 00:20:32.175225 (+ 408us) client_negotiation.cc:240] Negotiation successful
0812 00:20:32.175922 (+ 697us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1589,"thread_start_us":1342,"threads_started":1}
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
I20260812 00:20:32.179546 20110 heartbeater.cc:347] Connected to a master server at 127.18.163.254:37295
I20260812 00:20:32.180052 20110 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:32.181145 20110 heartbeater.cc:511] Master 127.18.163.254:37295 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
I20260812 00:20:32.183096 19740 ts_manager.cc:194] Registered new tserver with Master: 81f3fa86c60645cb8e4971ac6fa59f9e (127.18.163.194:41531)
I20260812 00:20:32.184463 19740 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:52059
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
I20260812 00:20:32.213179 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37295
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:37333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:32.574529 20116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:32.574872 20116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:32.575069 20116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:32.583380 20116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:32.583535 20116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:32.583715 20116 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:20:32.594710 20116 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:37333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37295
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:32.596138 20116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:32.597663 20116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:32.611909 20128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:32.611842 20124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:32.612447 20125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:32.613904 20116 server_base.cc:1034] running on GCE node
I20260812 00:20:32.614585 20116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:32.615641 20116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:32.616860 20116 hybrid_clock.cc:648] HybridClock initialized: now 1786494032616791 us; error 60 us; skew 500 ppm
I20260812 00:20:32.617202 20116 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:32 dist-test-slave-njxd krb5kdc[19687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494032, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:32.620630 20116 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:20:32.622282 20116 webserver.cc:460] Webserver started at http://127.18.163.195:35601/ using document root <none> and password file <none>
I20260812 00:20:32.623041 20116 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:32.623201 20116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:32.623554 20116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:32.626808 20116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "d5fae0599f4f447d8ed32eabbec7b041"
format_stamp: "Formatted at 2026-08-12 00:20:32 on dist-test-slave-njxd"
server_key: "0496184864e3309cda06f3d53b467f12"
server_key_iv: "f5b6309a27ee1bd81ec8245efee2e98e"
server_key_version: "encryptionkey@0"
I20260812 00:20:32.627664 20116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "d5fae0599f4f447d8ed32eabbec7b041"
format_stamp: "Formatted at 2026-08-12 00:20:32 on dist-test-slave-njxd"
server_key: "0496184864e3309cda06f3d53b467f12"
server_key_iv: "f5b6309a27ee1bd81ec8245efee2e98e"
server_key_version: "encryptionkey@0"
I20260812 00:20:32.633404 20116 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 00:20:32.637305 20135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:32.638841 20116 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:20:32.639051 20116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "d5fae0599f4f447d8ed32eabbec7b041"
format_stamp: "Formatted at 2026-08-12 00:20:32 on dist-test-slave-njxd"
server_key: "0496184864e3309cda06f3d53b467f12"
server_key_iv: "f5b6309a27ee1bd81ec8245efee2e98e"
server_key_version: "encryptionkey@0"
I20260812 00:20:32.639297 20116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:32.645098 19958 heartbeater.cc:503] Master 127.18.163.254:37295 was elected leader, sending a full tablet report...
I20260812 00:20:32.655972 20116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:32.660600 20116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:32.660953 20116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:32.662102 20116 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:20:32.663583 20116 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:32.663663 20116 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:32.663841 20116 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:32.663900 20116 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:32.702104 20116 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:39363
I20260812 00:20:32.702162 20261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:39363 every 8 connection(s)
I20260812 00:20:32.703627 20116 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:20:32.707069 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 20116
I20260812 00:20:32.707302 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:20:32.707751 19087 external_mini_cluster.cc:1428] Setting key 2ebc32624ec91ab6f02cd9ff116c5538
Aug 12 00:20:32 dist-test-slave-njxd krb5kdc[19687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494032, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:32.726028 20264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:32.706608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:56567 (local address 127.18.163.254:37295)
0812 00:20:32.707177 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:32.707185 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:32.708439 (+ 1254us) server_negotiation.cc:407] Connection header received
0812 00:20:32.710656 (+ 2217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:32.710661 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:32.710790 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:32.710914 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:32.712736 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.713520 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.715170 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.715597 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.715700 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:32.719386 (+ 3686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:32.719392 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:32.719395 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:32.719433 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:32.722641 (+ 3208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:32.723704 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:32.723713 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:32.723715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:32.723894 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:32.724380 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:32.724384 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:32.724386 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:32.724661 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:32.724792 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:32.725494 (+ 702us) server_negotiation.cc:299] Negotiation successful
0812 00:20:32.725733 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":270,"threads_started":1}
I20260812 00:20:32.727144 20265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:32.707300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:37295 (local address 127.18.163.195:56567)
0812 00:20:32.708232 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:32.708286 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:32.710370 (+ 2084us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:32.711231 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:32.711246 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:32.711853 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:32.712534 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:32.712562 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.713721 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.713725 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:32.715036 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:32.715048 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.715812 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.715816 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:32.716029 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:32.716707 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:32.716732 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:32.719137 (+ 2405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:32.722841 (+ 3704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:32.722851 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:32.722873 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:32.723567 (+ 694us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:32.724034 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:32.724038 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:32.724041 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:32.724280 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:32.724785 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:32.724791 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:32.725156 (+ 365us) client_negotiation.cc:769] Sending connection context
0812 00:20:32.725404 (+ 248us) client_negotiation.cc:240] Negotiation successful
0812 00:20:32.725913 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":382,"threads_started":1}
I20260812 00:20:32.728581 20262 heartbeater.cc:347] Connected to a master server at 127.18.163.254:37295
I20260812 00:20:32.728945 20262 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:32.729820 20262 heartbeater.cc:511] Master 127.18.163.254:37295 requested a full tablet report, sending...
I20260812 00:20:32.731312 19740 ts_manager.cc:194] Registered new tserver with Master: d5fae0599f4f447d8ed32eabbec7b041 (127.18.163.195:39363)
I20260812 00:20:32.732096 19740 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:56567
I20260812 00:20:32.736469 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:20:32.757030 20264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:32.743620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55154 (local address 127.18.163.254:37295)
0812 00:20:32.743849 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:32.743854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:32.744469 (+ 615us) server_negotiation.cc:407] Connection header received
0812 00:20:32.744625 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:32.744629 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:32.744726 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:32.744867 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:32.746582 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.747345 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.748624 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.749077 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.749201 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:32.751578 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:32.751584 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:32.751587 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:32.751625 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:32.754608 (+ 2983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:32.755267 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:32.755270 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:32.755273 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:32.755397 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:32.755739 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:32.755742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:32.755744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:32.756077 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:32.756268 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:32.756583 (+ 315us) server_negotiation.cc:299] Negotiation successful
0812 00:20:32.756783 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260812 00:20:32.764498 19740 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55154:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:20:32.771878 19740 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:20:32.806972 20277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:32.786534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:41531 (local address 127.0.0.1:54836)
0812 00:20:32.795752 (+ 9218us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:32.795807 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:32.796006 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:32.798225 (+ 2219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:32.798230 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:32.798264 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:32.798865 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:32.798881 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.800835 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.800840 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:32.803641 (+ 2801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:32.803666 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.805808 (+ 2142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.805814 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:32.806021 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:32.806084 (+ 63us) client_negotiation.cc:769] Sending connection context
0812 00:20:32.806214 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 00:20:32.806467 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8941,"mutex_wait_us":89,"thread_start_us":8768,"threads_started":1}
I20260812 00:20:32.807432 20282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:32.797848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:39363 (local address 127.0.0.1:45302)
0812 00:20:32.799251 (+ 1403us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:32.799274 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:32.799493 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:32.800423 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:32.800428 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:32.800452 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:32.801019 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:32.801031 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.802590 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.802597 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:32.804339 (+ 1742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:32.804351 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.806304 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.806309 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:32.806440 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:32.806469 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 00:20:32.806587 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 00:20:32.806732 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1267,"mutex_wait_us":4,"thread_start_us":326,"threads_started":1}
I20260812 00:20:32.807771 20281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:32.796762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45302 (local address 127.18.163.195:39363)
0812 00:20:32.797861 (+ 1099us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:32.797869 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:32.799377 (+ 1508us) server_negotiation.cc:407] Connection header received
0812 00:20:32.799701 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:32.799709 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:32.799945 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:32.800122 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:32.801233 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.802429 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.804508 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.805775 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.805984 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:32.806138 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:32.806638 (+ 500us) server_negotiation.cc:299] Negotiation successful
0812 00:20:32.806842 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":905,"thread_start_us":701,"threads_started":1}
I20260812 00:20:32.808434 20279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:32.786688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54836 (local address 127.18.163.194:41531)
0812 00:20:32.797494 (+ 10806us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:32.797504 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:32.797536 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:20:32.797667 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:32.797675 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:32.797926 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:32.798468 (+ 542us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:32.799029 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.800685 (+ 1656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.803877 (+ 3192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.805535 (+ 1658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.807596 (+ 2061us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:32.807813 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:32.807897 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 00:20:32.808090 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10570,"thread_start_us":10390,"threads_started":1}
I20260812 00:20:32.808495 20280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:32.787346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46000 (local address 127.18.163.193:40233)
0812 00:20:32.788261 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:32.788275 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:32.796874 (+ 8599us) server_negotiation.cc:407] Connection header received
0812 00:20:32.797045 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:32.797059 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:32.797392 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:32.797680 (+ 288us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:32.798966 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.800361 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.803876 (+ 3515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.805535 (+ 1659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.805781 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:32.806001 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:32.807980 (+ 1979us) server_negotiation.cc:299] Negotiation successful
0812 00:20:32.808152 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":370,"threads_started":1}
I20260812 00:20:32.809298 20278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:32.786714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:40233 (local address 127.0.0.1:46000)
0812 00:20:32.796685 (+ 9971us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:32.796705 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:32.796843 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:32.798017 (+ 1174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:32.798028 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:32.798073 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:32.798710 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:32.798732 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.800503 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.800511 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:32.803654 (+ 3143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:32.803666 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:32.807542 (+ 3876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:32.807549 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:32.807755 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:32.807785 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 00:20:32.808745 (+ 960us) client_negotiation.cc:240] Negotiation successful
0812 00:20:32.808862 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9838,"mutex_wait_us":155,"thread_start_us":9706,"threads_started":1}
I20260812 00:20:32.811962 20190 tablet_service.cc:1467] Processing CreateTablet for tablet ec0107f03f2e48a78fa40d55475dd4c6 (DEFAULT_TABLE table=test-table [id=6bed1de8fed147d0be574965b7c35b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:32.812592 20039 tablet_service.cc:1467] Processing CreateTablet for tablet ec0107f03f2e48a78fa40d55475dd4c6 (DEFAULT_TABLE table=test-table [id=6bed1de8fed147d0be574965b7c35b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:32.813078 19887 tablet_service.cc:1467] Processing CreateTablet for tablet ec0107f03f2e48a78fa40d55475dd4c6 (DEFAULT_TABLE table=test-table [id=6bed1de8fed147d0be574965b7c35b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:32.813740 20190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec0107f03f2e48a78fa40d55475dd4c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:32.814183 20039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec0107f03f2e48a78fa40d55475dd4c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:32.814626 19887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec0107f03f2e48a78fa40d55475dd4c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:32.825863 20283 tablet_bootstrap.cc:492] T ec0107f03f2e48a78fa40d55475dd4c6 P d5fae0599f4f447d8ed32eabbec7b041: Bootstrap starting.
I20260812 00:20:32.829396 20283 tablet_bootstrap.cc:654] T ec0107f03f2e48a78fa40d55475dd4c6 P d5fae0599f4f447d8ed32eabbec7b041: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:32.831254 20283 log.cc:824] T ec0107f03f2e48a78fa40d55475dd4c6 P d5fae0599f4f447d8ed32eabbec7b041: Log is configured to *not* fsync() on all Append() calls
I20260812 00:20:32.835043 20283 tablet_bootstrap.cc:492] T ec0107f03f2e48a78fa40d55475dd4c6 P d5fae0599f4f447d8ed32eabbec7b041: No bootstrap required, opened a new log
I20260812 00:20:32.835361 20283 ts_tablet_manager.cc:1397] T ec0107f03f2e48a78fa40d55475dd4c6 P d5fae0599f4f447d8ed32eabbec7b041: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260812 00:20:32.838241 20285 tablet_bootstrap.cc:492] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53: Bootstrap starting.
I20260812 00:20:32.838585 20284 tablet_bootstrap.cc:492] T ec0107f03f2e48a78fa40d55475dd4c6 P 81f3fa86c60645cb8e4971ac6fa59f9e: Bootstrap starting.
I20260812 00:20:32.842734 20284 tablet_bootstrap.cc:654] T ec0107f03f2e48a78fa40d55475dd4c6 P 81f3fa86c60645cb8e4971ac6fa59f9e: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:32.842801 20285 tablet_bootstrap.cc:654] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:32.844122 20284 log.cc:824] T ec0107f03f2e48a78fa40d55475dd4c6 P 81f3fa86c60645cb8e4971ac6fa59f9e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:20:32.844167 20285 log.cc:824] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53: Log is configured to *not* fsync() on all Append() calls
I20260812 00:20:32.847083 20283 raft_consensus.cc:348] T ec0107f03f2e48a78fa40d55475dd4c6 P d5fae0599f4f447d8ed32eabbec7b041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f3fa86c60645cb8e4971ac6fa59f9e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41531 } } peers { permanent_uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40233 } } peers { permanent_uuid: "d5fae0599f4f447d8ed32eabbec7b041" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39363 } }
I20260812 00:20:32.847501 20283 raft_consensus.cc:374] T ec0107f03f2e48a78fa40d55475dd4c6 P d5fae0599f4f447d8ed32eabbec7b041 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:32.847600 20283 raft_consensus.cc:729] T ec0107f03f2e48a78fa40d55475dd4c6 P d5fae0599f4f447d8ed32eabbec7b041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5fae0599f4f447d8ed32eabbec7b041, State: Initialized, Role: FOLLOWER
I20260812 00:20:32.847723 20284 tablet_bootstrap.cc:492] T ec0107f03f2e48a78fa40d55475dd4c6 P 81f3fa86c60645cb8e4971ac6fa59f9e: No bootstrap required, opened a new log
I20260812 00:20:32.848078 20284 ts_tablet_manager.cc:1397] T ec0107f03f2e48a78fa40d55475dd4c6 P 81f3fa86c60645cb8e4971ac6fa59f9e: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260812 00:20:32.848384 20283 consensus_queue.cc:260] T ec0107f03f2e48a78fa40d55475dd4c6 P d5fae0599f4f447d8ed32eabbec7b041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f3fa86c60645cb8e4971ac6fa59f9e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41531 } } peers { permanent_uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40233 } } peers { permanent_uuid: "d5fae0599f4f447d8ed32eabbec7b041" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39363 } }
I20260812 00:20:32.849727 20262 heartbeater.cc:503] Master 127.18.163.254:37295 was elected leader, sending a full tablet report...
I20260812 00:20:32.850472 20283 ts_tablet_manager.cc:1428] T ec0107f03f2e48a78fa40d55475dd4c6 P d5fae0599f4f447d8ed32eabbec7b041: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260812 00:20:32.850908 20285 tablet_bootstrap.cc:492] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53: No bootstrap required, opened a new log
I20260812 00:20:32.851212 20285 ts_tablet_manager.cc:1397] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.004s
I20260812 00:20:32.859428 20284 raft_consensus.cc:348] T ec0107f03f2e48a78fa40d55475dd4c6 P 81f3fa86c60645cb8e4971ac6fa59f9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f3fa86c60645cb8e4971ac6fa59f9e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41531 } } peers { permanent_uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40233 } } peers { permanent_uuid: "d5fae0599f4f447d8ed32eabbec7b041" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39363 } }
I20260812 00:20:32.860016 20284 raft_consensus.cc:374] T ec0107f03f2e48a78fa40d55475dd4c6 P 81f3fa86c60645cb8e4971ac6fa59f9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:32.860126 20284 raft_consensus.cc:729] T ec0107f03f2e48a78fa40d55475dd4c6 P 81f3fa86c60645cb8e4971ac6fa59f9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81f3fa86c60645cb8e4971ac6fa59f9e, State: Initialized, Role: FOLLOWER
I20260812 00:20:32.860867 20284 consensus_queue.cc:260] T ec0107f03f2e48a78fa40d55475dd4c6 P 81f3fa86c60645cb8e4971ac6fa59f9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f3fa86c60645cb8e4971ac6fa59f9e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41531 } } peers { permanent_uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40233 } } peers { permanent_uuid: "d5fae0599f4f447d8ed32eabbec7b041" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39363 } }
I20260812 00:20:32.862201 20110 heartbeater.cc:503] Master 127.18.163.254:37295 was elected leader, sending a full tablet report...
I20260812 00:20:32.863075 20284 ts_tablet_manager.cc:1428] T ec0107f03f2e48a78fa40d55475dd4c6 P 81f3fa86c60645cb8e4971ac6fa59f9e: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260812 00:20:32.863159 20285 raft_consensus.cc:348] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f3fa86c60645cb8e4971ac6fa59f9e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41531 } } peers { permanent_uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40233 } } peers { permanent_uuid: "d5fae0599f4f447d8ed32eabbec7b041" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39363 } }
I20260812 00:20:32.863662 20285 raft_consensus.cc:374] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:32.863795 20285 raft_consensus.cc:729] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e7b6b573abf4ebaa3a06a9ca582cd53, State: Initialized, Role: FOLLOWER
I20260812 00:20:32.864480 20285 consensus_queue.cc:260] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f3fa86c60645cb8e4971ac6fa59f9e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41531 } } peers { permanent_uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40233 } } peers { permanent_uuid: "d5fae0599f4f447d8ed32eabbec7b041" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39363 } }
I20260812 00:20:32.866499 20285 ts_tablet_manager.cc:1428] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
W20260812 00:20:32.901379 20111 tablet.cc:2369] T ec0107f03f2e48a78fa40d55475dd4c6 P 81f3fa86c60645cb8e4971ac6fa59f9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:20:32.955502 20263 tablet.cc:2369] T ec0107f03f2e48a78fa40d55475dd4c6 P d5fae0599f4f447d8ed32eabbec7b041: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:20:33.040189 20292 raft_consensus.cc:482] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:20:33.040505 20292 raft_consensus.cc:504] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f3fa86c60645cb8e4971ac6fa59f9e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41531 } } peers { permanent_uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40233 } } peers { permanent_uuid: "d5fae0599f4f447d8ed32eabbec7b041" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39363 } }
I20260812 00:20:33.042395 20292 leader_election.cc:288] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81f3fa86c60645cb8e4971ac6fa59f9e (127.18.163.194:41531), d5fae0599f4f447d8ed32eabbec7b041 (127.18.163.195:39363)
I20260812 00:20:33.050657 20279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:33.042968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:59037 (local address 127.18.163.194:41531)
0812 00:20:33.043233 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:33.043242 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:33.044046 (+ 804us) server_negotiation.cc:407] Connection header received
0812 00:20:33.044142 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:33.044149 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:33.044233 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:33.044339 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:33.045111 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.046197 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.048446 (+ 2249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.049550 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.049769 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:33.049831 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:33.050234 (+ 403us) server_negotiation.cc:299] Negotiation successful
0812 00:20:33.050339 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 00:20:33.050871 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:33.042846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:41531 (local address 127.18.163.193:59037)
0812 00:20:33.043699 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:33.043724 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:33.043908 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:33.044415 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:33.044424 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:33.044475 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:33.044947 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:33.044958 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.046332 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.046340 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:33.048272 (+ 1932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:33.048285 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.049851 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.049858 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:33.050052 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:33.050090 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:20:33.050201 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 00:20:33.050351 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":691,"mutex_wait_us":1,"thread_start_us":452,"threads_started":1}
I20260812 00:20:33.051469 20281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:33.043963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:58589 (local address 127.18.163.195:39363)
0812 00:20:33.044208 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:33.044214 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:33.045110 (+ 896us) server_negotiation.cc:407] Connection header received
0812 00:20:33.045283 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:33.045287 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:33.045346 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:33.045410 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:33.046061 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.047197 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.049204 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.050335 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.050494 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:33.050575 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:33.051064 (+ 489us) server_negotiation.cc:299] Negotiation successful
0812 00:20:33.051208 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260812 00:20:33.051538 20294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:33.043779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:39363 (local address 127.18.163.193:58589)
0812 00:20:33.044980 (+ 1201us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:33.045000 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:33.045146 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:33.045461 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:33.045467 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:33.045493 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:33.045893 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:33.045905 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.047337 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.047340 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:33.049004 (+ 1664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:33.049020 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.050584 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.050590 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:33.050814 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:33.050857 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 00:20:33.051029 (+ 172us) client_negotiation.cc:240] Negotiation successful
0812 00:20:33.051174 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1095,"thread_start_us":793,"threads_started":1}
I20260812 00:20:33.052110 20064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0107f03f2e48a78fa40d55475dd4c6" candidate_uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f3fa86c60645cb8e4971ac6fa59f9e" is_pre_election: true
I20260812 00:20:33.052682 20064 raft_consensus.cc:2454] T ec0107f03f2e48a78fa40d55475dd4c6 P 81f3fa86c60645cb8e4971ac6fa59f9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e7b6b573abf4ebaa3a06a9ca582cd53 in term 0.
I20260812 00:20:33.053494 19830 leader_election.cc:302] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e7b6b573abf4ebaa3a06a9ca582cd53, 81f3fa86c60645cb8e4971ac6fa59f9e; no voters:
I20260812 00:20:33.054049 20292 raft_consensus.cc:2781] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:20:33.054216 20292 raft_consensus.cc:482] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:20:33.054348 20292 raft_consensus.cc:3037] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:33.054133 20214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0107f03f2e48a78fa40d55475dd4c6" candidate_uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5fae0599f4f447d8ed32eabbec7b041" is_pre_election: true
I20260812 00:20:33.054737 20214 raft_consensus.cc:2454] T ec0107f03f2e48a78fa40d55475dd4c6 P d5fae0599f4f447d8ed32eabbec7b041 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e7b6b573abf4ebaa3a06a9ca582cd53 in term 0.
I20260812 00:20:33.056893 20292 raft_consensus.cc:504] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f3fa86c60645cb8e4971ac6fa59f9e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41531 } } peers { permanent_uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40233 } } peers { permanent_uuid: "d5fae0599f4f447d8ed32eabbec7b041" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39363 } }
I20260812 00:20:33.057531 20292 leader_election.cc:288] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 [CANDIDATE]: Term 1 election: Requested vote from peers 81f3fa86c60645cb8e4971ac6fa59f9e (127.18.163.194:41531), d5fae0599f4f447d8ed32eabbec7b041 (127.18.163.195:39363)
I20260812 00:20:33.058192 20064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0107f03f2e48a78fa40d55475dd4c6" candidate_uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81f3fa86c60645cb8e4971ac6fa59f9e"
I20260812 00:20:33.058235 20214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0107f03f2e48a78fa40d55475dd4c6" candidate_uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5fae0599f4f447d8ed32eabbec7b041"
I20260812 00:20:33.058446 20214 raft_consensus.cc:3037] T ec0107f03f2e48a78fa40d55475dd4c6 P d5fae0599f4f447d8ed32eabbec7b041 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:33.058446 20064 raft_consensus.cc:3037] T ec0107f03f2e48a78fa40d55475dd4c6 P 81f3fa86c60645cb8e4971ac6fa59f9e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:33.061929 20214 raft_consensus.cc:2454] T ec0107f03f2e48a78fa40d55475dd4c6 P d5fae0599f4f447d8ed32eabbec7b041 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e7b6b573abf4ebaa3a06a9ca582cd53 in term 1.
I20260812 00:20:33.061929 20064 raft_consensus.cc:2454] T ec0107f03f2e48a78fa40d55475dd4c6 P 81f3fa86c60645cb8e4971ac6fa59f9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e7b6b573abf4ebaa3a06a9ca582cd53 in term 1.
I20260812 00:20:33.062417 19830 leader_election.cc:302] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e7b6b573abf4ebaa3a06a9ca582cd53, d5fae0599f4f447d8ed32eabbec7b041; no voters:
I20260812 00:20:33.062754 20292 raft_consensus.cc:2781] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:20:33.063273 20292 raft_consensus.cc:686] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 [term 1 LEADER]: Becoming Leader. State: Replica: 7e7b6b573abf4ebaa3a06a9ca582cd53, State: Running, Role: LEADER
I20260812 00:20:33.063781 20292 consensus_queue.cc:237] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f3fa86c60645cb8e4971ac6fa59f9e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41531 } } peers { permanent_uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40233 } } peers { permanent_uuid: "d5fae0599f4f447d8ed32eabbec7b041" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39363 } }
I20260812 00:20:33.068456 19739 catalog_manager.cc:5495] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e7b6b573abf4ebaa3a06a9ca582cd53 (127.18.163.193). New cstate: current_term: 1 leader_uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81f3fa86c60645cb8e4971ac6fa59f9e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e7b6b573abf4ebaa3a06a9ca582cd53" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5fae0599f4f447d8ed32eabbec7b041" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39363 } health_report { overall_health: UNKNOWN } } }
Aug 12 00:20:33 dist-test-slave-njxd krb5kdc[19687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:20:33.104802 20280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:33.088945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46014 (local address 127.18.163.193:40233)
0812 00:20:33.089185 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:33.089194 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:33.089705 (+ 511us) server_negotiation.cc:407] Connection header received
0812 00:20:33.089939 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:33.089944 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:33.090015 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:33.090131 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:33.091739 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.092482 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.093843 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.094349 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.094489 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:33.099006 (+ 4517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:33.099027 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:33.099045 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:33.099096 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:33.102059 (+ 2963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:33.102800 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:33.102807 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:33.102810 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:33.102984 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:33.103337 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:33.103340 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:33.103342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:33.103707 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:33.103936 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:33.104191 (+ 255us) server_negotiation.cc:299] Negotiation successful
0812 00:20:33.104416 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260812 00:20:33.111608 19959 tablet.cc:2369] T ec0107f03f2e48a78fa40d55475dd4c6 P 7e7b6b573abf4ebaa3a06a9ca582cd53: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 00:20:33 dist-test-slave-njxd krb5kdc[19687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494033, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:20:33 dist-test-slave-njxd krb5kdc[19687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494033, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:20:33.162995 20280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:33.147252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46018 (local address 127.18.163.193:40233)
0812 00:20:33.147498 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:33.147508 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:33.147892 (+ 384us) server_negotiation.cc:407] Connection header received
0812 00:20:33.148118 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:33.148124 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:33.148204 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:33.148325 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:33.149866 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.150630 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.151941 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.152479 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.152634 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:33.157636 (+ 5002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:33.157643 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:33.157646 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:33.157687 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:33.160345 (+ 2658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:33.161187 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:33.161191 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:33.161193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:33.161342 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:33.161848 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:33.161851 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:33.161853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:33.162131 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:33.162378 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:33.162548 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 00:20:33.162731 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
Aug 12 00:20:33 dist-test-slave-njxd krb5kdc[19687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:20:33 dist-test-slave-njxd krb5kdc[19687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:20:33.220058 20280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:33.205424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46020 (local address 127.18.163.193:40233)
0812 00:20:33.205709 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:33.205717 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:33.205951 (+ 234us) server_negotiation.cc:407] Connection header received
0812 00:20:33.206184 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:33.206188 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:33.206282 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:33.206401 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:33.207892 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.208717 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.210107 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.210524 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.210671 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:33.214900 (+ 4229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:33.214906 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:33.214909 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:33.214952 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:33.217520 (+ 2568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:33.218297 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:33.218302 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:33.218304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:33.218446 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:33.218805 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:33.218808 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:33.218811 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:33.219102 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:33.219320 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:33.219590 (+ 270us) server_negotiation.cc:299] Negotiation successful
0812 00:20:33.219777 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260812 00:20:33.222172 19860 tablet_service.cc:2908] Rejecting scan request for tablet ec0107f03f2e48a78fa40d55475dd4c6: Uninitialized: clean time has not yet been initialized
I20260812 00:20:33.225489 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 19811
I20260812 00:20:33.239300 20280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:33.226765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46028 (local address 127.18.163.193:40233)
0812 00:20:33.227001 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:33.227011 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:33.227342 (+ 331us) server_negotiation.cc:407] Connection header received
0812 00:20:33.227478 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:33.227482 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:33.227544 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:33.227628 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:33.228974 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.229778 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.230994 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.231404 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.231497 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:33.233994 (+ 2497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:33.233999 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:33.234002 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:33.234035 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:33.236619 (+ 2584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:33.237379 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:33.237383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:33.237386 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:33.237517 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:33.237914 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:33.237918 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:33.237920 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:33.238210 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:33.238429 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:33.238670 (+ 241us) server_negotiation.cc:299] Negotiation successful
0812 00:20:33.238886 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:20:33.240056 19953 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:20:33.337219 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 19811
I20260812 00:20:33.364197 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 19965
Aug 12 00:20:33 dist-test-slave-njxd krb5kdc[19687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
I20260812 00:20:33.383565 20279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:33.365154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54844 (local address 127.18.163.194:41531)
0812 00:20:33.365321 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:33.365326 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:33.365382 (+ 56us) server_negotiation.cc:407] Connection header received
0812 00:20:33.365635 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:33.365640 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:33.365719 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:33.365857 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:33.367586 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.368309 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.370550 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.370958 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.371101 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:33.376523 (+ 5422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:33.376541 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:33.376557 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:33.376604 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:33.380010 (+ 3406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:33.380939 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:33.380947 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:33.380949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:33.381147 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:33.381624 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:33.381633 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:33.381637 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:33.382229 (+ 592us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:33.382619 (+ 390us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:33.382814 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 00:20:33.383103 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 00:20:33.384321 20104 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:20:33.483743 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 19965
I20260812 00:20:33.507570 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 20116
Aug 12 00:20:33 dist-test-slave-njxd krb5kdc[19687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:20:33.523880 20281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:33.508449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45304 (local address 127.18.163.195:39363)
0812 00:20:33.508667 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:33.508673 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:33.508695 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:20:33.508912 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:33.508916 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:33.508984 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:33.509108 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:33.510537 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.511287 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.512687 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:33.513111 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:33.513259 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:33.518036 (+ 4777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:33.518056 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:33.518074 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:33.518126 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:33.521134 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:33.521939 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:33.521947 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:33.521949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:33.522107 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:33.522476 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:33.522480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:33.522482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:33.522883 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:33.523120 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:33.523400 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 00:20:33.523587 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:20:33.524564 20257 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:20:33.615948 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 20116
I20260812 00:20:33.639113 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 19700
I20260812 00:20:33.640447 19773 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:20:33.756865 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 19700
2026-08-12T00:20:33Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4719 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:20:33 dist-test-slave-njxd krb5kdc[20316](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:20:33 dist-test-slave-njxd krb5kdc[20316](info): set up 2 sockets
Aug 12 00:20:33 dist-test-slave-njxd krb5kdc[20316](info): commencing operation
krb5kdc: starting...
W20260812 00:20:34.921245 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.000s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:20:35 dist-test-slave-njxd krb5kdc[20316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:20:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:20:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:20:35.165952 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:43257
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:44477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:43257
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:35.523756 20336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:35.524156 20336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:35.524343 20336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:35.532167 20336 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:20:35.532362 20336 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 00:20:35.532467 20336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:35.532596 20336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:35.532686 20336 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:20:35.532789 20336 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:20:35.543584 20336 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:44477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:43257
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:43257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:35.545105 20336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:35.546624 20336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:35.559206 20341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:35.559183 20344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:35.559412 20342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:35.560477 20336 server_base.cc:1034] running on GCE node
I20260812 00:20:35.561446 20336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:35.563045 20336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:35.564294 20336 hybrid_clock.cc:648] HybridClock initialized: now 1786494035564226 us; error 33 us; skew 500 ppm
I20260812 00:20:35.564724 20336 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:35 dist-test-slave-njxd krb5kdc[20316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494035, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:35.568230 20336 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:20:35.570029 20336 webserver.cc:460] Webserver started at http://127.18.163.254:43611/ using document root <none> and password file <none>
I20260812 00:20:35.570851 20336 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:35.570998 20336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:35.571365 20336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:35.574793 20336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "787776b6dde346e6b459248e1864c8cb"
format_stamp: "Formatted at 2026-08-12 00:20:35 on dist-test-slave-njxd"
server_key: "7adde53c5e543d955e4e3653dbc8bc27"
server_key_iv: "0a5dcf87b15b4ef36bce0e75a7a7cd7a"
server_key_version: "encryptionkey@0"
I20260812 00:20:35.575685 20336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "787776b6dde346e6b459248e1864c8cb"
format_stamp: "Formatted at 2026-08-12 00:20:35 on dist-test-slave-njxd"
server_key: "7adde53c5e543d955e4e3653dbc8bc27"
server_key_iv: "0a5dcf87b15b4ef36bce0e75a7a7cd7a"
server_key_version: "encryptionkey@0"
I20260812 00:20:35.582113 20336 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 00:20:35.586217 20353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:35.587781 20336 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:20:35.588003 20336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "787776b6dde346e6b459248e1864c8cb"
format_stamp: "Formatted at 2026-08-12 00:20:35 on dist-test-slave-njxd"
server_key: "7adde53c5e543d955e4e3653dbc8bc27"
server_key_iv: "0a5dcf87b15b4ef36bce0e75a7a7cd7a"
server_key_version: "encryptionkey@0"
I20260812 00:20:35.588270 20336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:35.608348 20336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:35.613080 20336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:35.613408 20336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:35.637866 20336 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:43257
I20260812 00:20:35.637873 20423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:43257 every 8 connection(s)
I20260812 00:20:35.639441 20336 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:20:35.641199 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 20336
I20260812 00:20:35.641474 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:20:35.642424 19087 external_mini_cluster.cc:1428] Setting key 50f7cf16747e17bf74641c79f1e2960d
I20260812 00:20:35.644847 20424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:35.657826 20424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb: Bootstrap starting.
Aug 12 00:20:35 dist-test-slave-njxd krb5kdc[20316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:35.661947 20424 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:35.663215 20424 log.cc:824] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb: Log is configured to *not* fsync() on all Append() calls
I20260812 00:20:35.667063 20424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb: No bootstrap required, opened a new log
I20260812 00:20:35.668143 20428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:35.644863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47410 (local address 127.18.163.254:43257)
0812 00:20:35.645835 (+ 972us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:35.645849 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:35.645897 (+ 48us) server_negotiation.cc:407] Connection header received
0812 00:20:35.647755 (+ 1858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:35.647783 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:35.648267 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:35.648760 (+ 493us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:35.650529 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:35.651973 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:35.653318 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:35.654316 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:35.654531 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:35.659329 (+ 4798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:35.659339 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:35.659361 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:35.659415 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:35.663135 (+ 3720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:35.664203 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:35.664214 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:35.664222 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:35.664415 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:35.664931 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:35.664936 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:35.664940 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:35.665526 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:35.665937 (+ 411us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:35.666455 (+ 518us) server_negotiation.cc:299] Negotiation successful
0812 00:20:35.666909 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":720,"thread_start_us":426,"threads_started":1}
I20260812 00:20:35.675318 20424 raft_consensus.cc:348] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "787776b6dde346e6b459248e1864c8cb" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 43257 } }
I20260812 00:20:35.675781 20424 raft_consensus.cc:374] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:35.675918 20424 raft_consensus.cc:729] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787776b6dde346e6b459248e1864c8cb, State: Initialized, Role: FOLLOWER
I20260812 00:20:35.676529 20424 consensus_queue.cc:260] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "787776b6dde346e6b459248e1864c8cb" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 43257 } }
I20260812 00:20:35.676805 20424 raft_consensus.cc:388] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:20:35.676959 20424 raft_consensus.cc:482] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:20:35.677157 20424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:35.679832 20424 raft_consensus.cc:504] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "787776b6dde346e6b459248e1864c8cb" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 43257 } }
I20260812 00:20:35.680454 20424 leader_election.cc:302] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 787776b6dde346e6b459248e1864c8cb; no voters:
I20260812 00:20:35.681092 20424 leader_election.cc:288] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:20:35.681262 20430 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:20:35.682106 20430 raft_consensus.cc:686] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [term 1 LEADER]: Becoming Leader. State: Replica: 787776b6dde346e6b459248e1864c8cb, State: Running, Role: LEADER
I20260812 00:20:35.682817 20430 consensus_queue.cc:237] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "787776b6dde346e6b459248e1864c8cb" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 43257 } }
I20260812 00:20:35.683705 20424 sys_catalog.cc:564] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:20:35.686172 20431 sys_catalog.cc:455] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "787776b6dde346e6b459248e1864c8cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "787776b6dde346e6b459248e1864c8cb" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 43257 } } }
I20260812 00:20:35.686127 20432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 787776b6dde346e6b459248e1864c8cb. Latest consensus state: current_term: 1 leader_uuid: "787776b6dde346e6b459248e1864c8cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "787776b6dde346e6b459248e1864c8cb" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 43257 } } }
I20260812 00:20:35.686611 20431 sys_catalog.cc:458] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [sys.catalog]: This master's current role is: LEADER
I20260812 00:20:35.686636 20432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb [sys.catalog]: This master's current role is: LEADER
I20260812 00:20:35.687621 20439 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:20:35.693886 20439 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:20:35.705672 20439 catalog_manager.cc:1347] Generated new cluster ID: 87873e8490d94ef085675a78296a7fb2
I20260812 00:20:35.705832 20439 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:20:35.743676 20439 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:20:35.745886 20439 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:20:35.755554 20439 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb: Generated new TSK 0
I20260812 00:20:35.756754 20439 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:20:35.813982 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:43257
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:44477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:36.180357 20458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:36.180769 20458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:36.180943 20458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:36.189147 20458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:36.189337 20458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:36.189505 20458 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:20:36.189684 20458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:20:36.200616 20458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:44477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.163.254:43257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:36.202229 20458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:36.203742 20458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:36.218393 20466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:36.218370 20463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:36.218315 20464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:36.223183 20458 server_base.cc:1034] running on GCE node
I20260812 00:20:36.223938 20458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:36.225018 20458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:36.226286 20458 hybrid_clock.cc:648] HybridClock initialized: now 1786494036226199 us; error 68 us; skew 500 ppm
I20260812 00:20:36.226611 20458 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:36 dist-test-slave-njxd krb5kdc[20316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494036, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:36.233059 20458 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:20:36.234949 20458 webserver.cc:460] Webserver started at http://127.18.163.193:39381/ using document root <none> and password file <none>
I20260812 00:20:36.235782 20458 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:36.235927 20458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:36.236301 20458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:36.239584 20458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "78acbff041394e8db7ffccda3ae26004"
format_stamp: "Formatted at 2026-08-12 00:20:36 on dist-test-slave-njxd"
server_key: "59a56996518afdf8ed5528b510d6bacb"
server_key_iv: "315ed20d8a6756cf126aeebcad9d6f38"
server_key_version: "encryptionkey@0"
I20260812 00:20:36.240476 20458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "78acbff041394e8db7ffccda3ae26004"
format_stamp: "Formatted at 2026-08-12 00:20:36 on dist-test-slave-njxd"
server_key: "59a56996518afdf8ed5528b510d6bacb"
server_key_iv: "315ed20d8a6756cf126aeebcad9d6f38"
server_key_version: "encryptionkey@0"
I20260812 00:20:36.246603 20458 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260812 00:20:36.250655 20474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:36.252239 20458 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:20:36.252460 20458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "78acbff041394e8db7ffccda3ae26004"
format_stamp: "Formatted at 2026-08-12 00:20:36 on dist-test-slave-njxd"
server_key: "59a56996518afdf8ed5528b510d6bacb"
server_key_iv: "315ed20d8a6756cf126aeebcad9d6f38"
server_key_version: "encryptionkey@0"
I20260812 00:20:36.252734 20458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:36.270533 20458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:36.275208 20458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:36.275533 20458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:36.278755 20458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:36.278880 20458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:36.279043 20458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:36.279139 20458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:20:36 dist-test-slave-njxd krb5kdc[20316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494036, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:36.304363 20485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:36.279464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:38335 (local address 127.18.163.254:43257)
0812 00:20:36.280248 (+ 784us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:36.280255 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:36.281463 (+ 1208us) server_negotiation.cc:407] Connection header received
0812 00:20:36.283739 (+ 2276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:36.283744 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:36.283865 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:36.283991 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:36.286520 (+ 2529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:36.287899 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:36.290945 (+ 3046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:36.291602 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:36.291805 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:36.296525 (+ 4720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:36.296533 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:36.296537 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:36.296594 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:36.300291 (+ 3697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:36.301530 (+ 1239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:36.301540 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:36.301546 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:36.301783 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:36.302397 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:36.302403 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:36.302406 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:36.302711 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:36.302887 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:36.303697 (+ 810us) server_negotiation.cc:299] Negotiation successful
0812 00:20:36.303960 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":509,"threads_started":1}
I20260812 00:20:36.305783 20486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:36.280286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:43257 (local address 127.18.163.193:38335)
0812 00:20:36.281248 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:36.281310 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:36.283427 (+ 2117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:36.284309 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:36.284324 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:36.285268 (+ 944us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:36.286214 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:36.286263 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:36.288131 (+ 1868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:36.288139 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:36.290746 (+ 2607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:36.290767 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:36.291940 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:36.291948 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:36.292220 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:36.293023 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:36.293049 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:36.296189 (+ 3140us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:36.300486 (+ 4297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:36.300498 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:36.300518 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:36.301316 (+ 798us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:36.301967 (+ 651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:36.301972 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:36.301977 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:36.302243 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:36.302857 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:36.302866 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:36.303292 (+ 426us) client_negotiation.cc:769] Sending connection context
0812 00:20:36.303574 (+ 282us) client_negotiation.cc:240] Negotiation successful
0812 00:20:36.304177 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":409,"threads_started":1}
I20260812 00:20:36.335775 20458 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:36881
I20260812 00:20:36.335812 20611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:36881 every 8 connection(s)
I20260812 00:20:36.337323 20569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:36.320687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:43257 (local address 127.18.163.193:42665)
0812 00:20:36.321662 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:36.321694 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:36.321984 (+ 290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:36.322477 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:36.322486 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:36.323321 (+ 835us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:36.323959 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:36.323977 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:36.325246 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:36.325258 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:36.326726 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:36.326741 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:36.328025 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:36.328036 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:36.328320 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:36.329019 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:36.329039 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:36.330356 (+ 1317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:36.334234 (+ 3878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:36.334240 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:36.334244 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:36.334857 (+ 613us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:36.335421 (+ 564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:36.335425 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:36.335427 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:36.335651 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:36.336367 (+ 716us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:36.336371 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:36.336551 (+ 180us) client_negotiation.cc:769] Sending connection context
0812 00:20:36.336671 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 00:20:36.336969 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"thread_start_us":474,"threads_started":1}
I20260812 00:20:36.337486 20485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:36.320617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:42665 (local address 127.18.163.254:43257)
0812 00:20:36.320851 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:36.320861 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:36.321822 (+ 961us) server_negotiation.cc:407] Connection header received
0812 00:20:36.322189 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:36.322196 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:36.322310 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:36.322432 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:36.324156 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:36.325093 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:36.326908 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:36.327506 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:36.327681 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:36.330615 (+ 2934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:36.330621 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:36.330626 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:36.330668 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:36.334065 (+ 3397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:36.335062 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:36.335070 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:36.335077 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:36.335294 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:36.335822 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:36.335829 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:36.335835 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:36.336228 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:36.336414 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:36.336848 (+ 434us) server_negotiation.cc:299] Negotiation successful
0812 00:20:36.337140 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:20:36.337677 20458 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:20:36.340751 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 20458
I20260812 00:20:36.341001 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:20:36.340054 20612 heartbeater.cc:347] Connected to a master server at 127.18.163.254:43257
I20260812 00:20:36.341964 20612 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:36.341957 19087 external_mini_cluster.cc:1428] Setting key 738f43bc7ba0d7d2c77f029f3afc90e1
I20260812 00:20:36.342887 20612 heartbeater.cc:511] Master 127.18.163.254:43257 requested a full tablet report, sending...
I20260812 00:20:36.345043 20374 ts_manager.cc:194] Registered new tserver with Master: 78acbff041394e8db7ffccda3ae26004 (127.18.163.193:36881)
I20260812 00:20:36.346692 20374 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:38335
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:20:36.397087 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:43257
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:44477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:36.768146 20616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:36.768476 20616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:36.768641 20616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:36.776451 20616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:36.776594 20616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:36.776746 20616 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:20:36.776889 20616 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:20:36.787591 20616 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:44477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.163.254:43257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:36.789062 20616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:36.790643 20616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:36.805922 20622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:36.805871 20623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:36.805847 20625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:36.807188 20616 server_base.cc:1034] running on GCE node
I20260812 00:20:36.807958 20616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:36.809110 20616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:36.810405 20616 hybrid_clock.cc:648] HybridClock initialized: now 1786494036810314 us; error 56 us; skew 500 ppm
I20260812 00:20:36.810743 20616 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:36 dist-test-slave-njxd krb5kdc[20316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494036, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:36.814270 20616 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:20:36.815939 20616 webserver.cc:460] Webserver started at http://127.18.163.194:42859/ using document root <none> and password file <none>
I20260812 00:20:36.816754 20616 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:36.816907 20616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:36.817276 20616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:36.820591 20616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "e1e8a65f13b14fff85554fdf2439b2fd"
format_stamp: "Formatted at 2026-08-12 00:20:36 on dist-test-slave-njxd"
server_key: "fa1ba299413458492ce56ee8594fede4"
server_key_iv: "cef29555ce1559686a6df3a0b09faeed"
server_key_version: "encryptionkey@0"
I20260812 00:20:36.821537 20616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "e1e8a65f13b14fff85554fdf2439b2fd"
format_stamp: "Formatted at 2026-08-12 00:20:36 on dist-test-slave-njxd"
server_key: "fa1ba299413458492ce56ee8594fede4"
server_key_iv: "cef29555ce1559686a6df3a0b09faeed"
server_key_version: "encryptionkey@0"
I20260812 00:20:36.827561 20616 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:20:36.831662 20632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:36.833242 20616 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:20:36.833475 20616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "e1e8a65f13b14fff85554fdf2439b2fd"
format_stamp: "Formatted at 2026-08-12 00:20:36 on dist-test-slave-njxd"
server_key: "fa1ba299413458492ce56ee8594fede4"
server_key_iv: "cef29555ce1559686a6df3a0b09faeed"
server_key_version: "encryptionkey@0"
I20260812 00:20:36.833812 20616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:36.848433 20616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:36.853055 20616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:36.853382 20616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:36.856761 20616 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:36.856894 20616 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:36.857071 20616 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:36.857178 20616 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:20:36 dist-test-slave-njxd krb5kdc[20316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494036, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:36.885131 20643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:36.857482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:50877 (local address 127.18.163.254:43257)
0812 00:20:36.858411 (+ 929us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:36.858418 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:36.859641 (+ 1223us) server_negotiation.cc:407] Connection header received
0812 00:20:36.862225 (+ 2584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:36.862231 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:36.862355 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:36.862477 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:36.864415 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:36.865618 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:36.868418 (+ 2800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:36.869068 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:36.869275 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:36.876280 (+ 7005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:36.876286 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:36.876289 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:36.876333 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:36.880127 (+ 3794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:36.881622 (+ 1495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:36.881631 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:36.881637 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:36.881860 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:36.882438 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:36.882446 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:36.882452 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:36.882973 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:36.883197 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:36.884443 (+ 1246us) server_negotiation.cc:299] Negotiation successful
0812 00:20:36.884697 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":789,"thread_start_us":651,"threads_started":1}
I20260812 00:20:36.886253 20644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:36.858391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:43257 (local address 127.18.163.194:50877)
0812 00:20:36.859398 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:36.859454 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:36.861849 (+ 2395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:36.862764 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:36.862774 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:36.863361 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:36.864174 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:36.864198 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:36.865835 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:36.865839 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:36.868110 (+ 2271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:36.868139 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:36.869482 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:36.869498 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:36.869976 (+ 478us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:36.870958 (+ 982us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:36.870998 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:36.875927 (+ 4929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:36.880389 (+ 4462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:36.880399 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:36.880423 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:36.881369 (+ 946us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:36.882013 (+ 644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:36.882021 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:36.882025 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:36.882290 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:36.883185 (+ 895us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:36.883192 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:36.883590 (+ 398us) client_negotiation.cc:769] Sending connection context
0812 00:20:36.883972 (+ 382us) client_negotiation.cc:240] Negotiation successful
0812 00:20:36.884698 (+ 726us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"thread_start_us":425,"threads_started":1}
I20260812 00:20:36.915506 20616 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:45015
I20260812 00:20:36.915530 20770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:45015 every 8 connection(s)
I20260812 00:20:36.916814 20643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:36.896789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:41519 (local address 127.18.163.254:43257)
0812 00:20:36.897005 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:36.897010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:36.898329 (+ 1319us) server_negotiation.cc:407] Connection header received
0812 00:20:36.898738 (+ 409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:36.898748 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:36.898869 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:36.899008 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:36.901221 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:36.902627 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:36.905673 (+ 3046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:36.906126 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:36.906321 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:36.909358 (+ 3037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:36.909364 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:36.909368 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:36.909439 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:36.913411 (+ 3972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:36.914491 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:36.914498 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:36.914501 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:36.914699 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:36.915154 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:36.915159 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:36.915163 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:36.915520 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:36.915697 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:36.916161 (+ 464us) server_negotiation.cc:299] Negotiation successful
0812 00:20:36.916435 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 00:20:36.916957 20717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:36.897285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:43257 (local address 127.18.163.194:41519)
0812 00:20:36.898182 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:36.898211 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:36.898488 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:36.899256 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:36.899262 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:36.900252 (+ 990us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:36.900934 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:36.900961 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:36.902922 (+ 1961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:36.902929 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:36.905364 (+ 2435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:36.905391 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:36.906697 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:36.906703 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:36.906843 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:36.907748 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:36.907772 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:36.909045 (+ 1273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:36.913636 (+ 4591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:36.913641 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:36.913656 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:36.914287 (+ 631us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:36.914848 (+ 561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:36.914853 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:36.914857 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:36.915017 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:36.915668 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:36.915673 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:36.915885 (+ 212us) client_negotiation.cc:769] Sending connection context
0812 00:20:36.916055 (+ 170us) client_negotiation.cc:240] Negotiation successful
0812 00:20:36.916457 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":703,"thread_start_us":484,"threads_started":1}
I20260812 00:20:36.917315 20616 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:20:36.919858 20771 heartbeater.cc:347] Connected to a master server at 127.18.163.254:43257
I20260812 00:20:36.920625 20771 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:36.921622 20771 heartbeater.cc:511] Master 127.18.163.254:43257 requested a full tablet report, sending...
I20260812 00:20:36.923128 20374 ts_manager.cc:194] Registered new tserver with Master: e1e8a65f13b14fff85554fdf2439b2fd (127.18.163.194:45015)
I20260812 00:20:36.923769 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 20616
I20260812 00:20:36.923987 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:20:36.924034 20374 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:50877
I20260812 00:20:36.924485 19087 external_mini_cluster.cc:1428] Setting key d03188b36b1e726306cf44c27365c7ce
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
I20260812 00:20:36.977037 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:43257
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:44477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:20:37.350796 20612 heartbeater.cc:503] Master 127.18.163.254:43257 was elected leader, sending a full tablet report...
W20260812 00:20:37.356627 20775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:37.357014 20775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:37.357138 20775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:37.365290 20775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:37.365432 20775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:37.365522 20775 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:20:37.365684 20775 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:20:37.376544 20775 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:44477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.163.254:43257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:37.378052 20775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:37.379489 20775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:37.394879 20785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:37.394923 20782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:37.394879 20783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:37.395941 20775 server_base.cc:1034] running on GCE node
I20260812 00:20:37.396580 20775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:37.397665 20775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:37.398912 20775 hybrid_clock.cc:648] HybridClock initialized: now 1786494037398845 us; error 36 us; skew 500 ppm
I20260812 00:20:37.399276 20775 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:37 dist-test-slave-njxd krb5kdc[20316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494037, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:37.402840 20775 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:20:37.404443 20775 webserver.cc:460] Webserver started at http://127.18.163.195:41475/ using document root <none> and password file <none>
I20260812 00:20:37.405216 20775 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:37.405310 20775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:37.405673 20775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:37.409129 20775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "8efe2ab4f75c465d808352336ada3e6e"
format_stamp: "Formatted at 2026-08-12 00:20:37 on dist-test-slave-njxd"
server_key: "14036dea1fd5e3f3972f91170df22d73"
server_key_iv: "06ce486f791c5a675bc58ccb6eee55d4"
server_key_version: "encryptionkey@0"
I20260812 00:20:37.410105 20775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "8efe2ab4f75c465d808352336ada3e6e"
format_stamp: "Formatted at 2026-08-12 00:20:37 on dist-test-slave-njxd"
server_key: "14036dea1fd5e3f3972f91170df22d73"
server_key_iv: "06ce486f791c5a675bc58ccb6eee55d4"
server_key_version: "encryptionkey@0"
I20260812 00:20:37.415866 20775 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:20:37.419937 20793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:37.421497 20775 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:20:37.421773 20775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "8efe2ab4f75c465d808352336ada3e6e"
format_stamp: "Formatted at 2026-08-12 00:20:37 on dist-test-slave-njxd"
server_key: "14036dea1fd5e3f3972f91170df22d73"
server_key_iv: "06ce486f791c5a675bc58ccb6eee55d4"
server_key_version: "encryptionkey@0"
I20260812 00:20:37.422049 20775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:37.445160 20775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:37.450364 20775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:37.450696 20775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:37.453940 20775 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:37.454073 20775 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:37.454267 20775 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:37.454353 20775 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:20:37 dist-test-slave-njxd krb5kdc[20316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494037, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:37.482452 20805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:37.456038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:48171 (local address 127.18.163.254:43257)
0812 00:20:37.456542 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:37.456549 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:37.456643 (+ 94us) server_negotiation.cc:407] Connection header received
0812 00:20:37.460016 (+ 3373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:37.460021 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:37.460126 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:37.460269 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:37.463204 (+ 2935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.464631 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.466713 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.467592 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.467792 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:37.473238 (+ 5446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:37.473244 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:37.473247 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:37.473292 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:37.477837 (+ 4545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:37.479188 (+ 1351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:37.479193 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:37.479196 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:37.479424 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:37.480209 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:37.480217 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:37.480223 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:37.480661 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:37.480847 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:37.481749 (+ 902us) server_negotiation.cc:299] Negotiation successful
0812 00:20:37.482020 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":252,"threads_started":1}
I20260812 00:20:37.483801 20804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:37.455371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:43257 (local address 127.18.163.195:48171)
0812 00:20:37.456416 (+ 1045us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:37.456489 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:37.459546 (+ 3057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:37.460615 (+ 1069us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:37.460625 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:37.461847 (+ 1222us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:37.462888 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:37.462919 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.464852 (+ 1933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.464857 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:37.466496 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:37.466513 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.468017 (+ 1504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.468028 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:37.468270 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:37.469174 (+ 904us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:37.469206 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:37.472886 (+ 3680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:37.478125 (+ 5239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:37.478143 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:37.478166 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:37.478988 (+ 822us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:37.479605 (+ 617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:37.479613 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:37.479619 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:37.480027 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:37.480824 (+ 797us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:37.480834 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:37.481283 (+ 449us) client_negotiation.cc:769] Sending connection context
0812 00:20:37.481584 (+ 301us) client_negotiation.cc:240] Negotiation successful
0812 00:20:37.482283 (+ 699us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":685,"thread_start_us":442,"threads_started":1}
I20260812 00:20:37.510778 20933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:40085 every 8 connection(s)
I20260812 00:20:37.510840 20775 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:40085
I20260812 00:20:37.512625 20775 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:20:37.513834 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 20775
I20260812 00:20:37.514055 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:20:37.514634 19087 external_mini_cluster.cc:1428] Setting key 3e2947c035ffc9d9bd05bb3d27d80759
I20260812 00:20:37.515519 20934 heartbeater.cc:347] Connected to a master server at 127.18.163.254:43257
I20260812 00:20:37.515758 20883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:37.493024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:43257 (local address 127.18.163.195:53057)
0812 00:20:37.494655 (+ 1631us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:37.494673 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:37.494821 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:37.495484 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:37.495491 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:37.496429 (+ 938us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:37.497234 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:37.497272 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.499257 (+ 1985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.499275 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:37.501991 (+ 2716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:37.502017 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.503771 (+ 1754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.503788 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:37.504067 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:37.505010 (+ 943us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:37.505044 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:37.506865 (+ 1821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:37.511732 (+ 4867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:37.511737 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:37.511740 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:37.512241 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:37.512797 (+ 556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:37.512802 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:37.512805 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:37.512963 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:37.513960 (+ 997us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:37.513969 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:37.514297 (+ 328us) client_negotiation.cc:769] Sending connection context
0812 00:20:37.514489 (+ 192us) client_negotiation.cc:240] Negotiation successful
0812 00:20:37.515023 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1432,"thread_start_us":1143,"threads_started":1}
I20260812 00:20:37.515883 20934 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:37.516922 20805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:37.492929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:53057 (local address 127.18.163.254:43257)
0812 00:20:37.493213 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:37.493223 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:37.494797 (+ 1574us) server_negotiation.cc:407] Connection header received
0812 00:20:37.494942 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:37.494951 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:37.495063 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:37.495191 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:37.497554 (+ 2363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.498962 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.502311 (+ 3349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.503224 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.503403 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:37.507255 (+ 3852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:37.507277 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:37.507282 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:37.507337 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:37.511505 (+ 4168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:37.512421 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:37.512428 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:37.512432 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:37.512649 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:37.513104 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:37.513113 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:37.513119 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:37.513632 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:37.513861 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:37.516313 (+ 2452us) server_negotiation.cc:299] Negotiation successful
0812 00:20:37.516551 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260812 00:20:37.517668 20934 heartbeater.cc:511] Master 127.18.163.254:43257 requested a full tablet report, sending...
I20260812 00:20:37.519472 20373 ts_manager.cc:194] Registered new tserver with Master: 8efe2ab4f75c465d808352336ada3e6e (127.18.163.195:40085)
I20260812 00:20:37.520725 20373 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:48171
I20260812 00:20:37.531221 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:20:37 dist-test-slave-njxd krb5kdc[20316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494037, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:20:37 dist-test-slave-njxd krb5kdc[20316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494037, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:37.592818 20805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:37.576698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47420 (local address 127.18.163.254:43257)
0812 00:20:37.576963 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:37.576970 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:37.577104 (+ 134us) server_negotiation.cc:407] Connection header received
0812 00:20:37.577384 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:37.577389 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:37.577458 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:37.577571 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:37.579129 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.579884 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.581261 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.581814 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.581959 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:37.586797 (+ 4838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:37.586804 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:37.586807 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:37.586855 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:37.590012 (+ 3157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:37.590834 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:37.590838 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:37.590841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:37.590993 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:37.591373 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:37.591376 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:37.591378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:37.591671 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:37.591952 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:37.592178 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 00:20:37.592415 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260812 00:20:37.597653 20373 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47420:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:20:37.604980 20373 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:20:37.632390 20948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:37.619810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:40085 (local address 127.0.0.1:35344)
0812 00:20:37.621197 (+ 1387us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:37.621272 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:37.621476 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:37.623063 (+ 1587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:37.623071 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:37.623111 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:37.623715 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:37.623735 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.626367 (+ 2632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.626376 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:37.628998 (+ 2622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:37.629012 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.631104 (+ 2092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.631112 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:37.631363 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:37.631439 (+ 76us) client_negotiation.cc:769] Sending connection context
0812 00:20:37.631584 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 00:20:37.631820 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1144,"mutex_wait_us":171,"spinlock_wait_cycles":2688,"thread_start_us":907,"threads_started":1}
I20260812 00:20:37.632493 20950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:37.619423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:36881 (local address 127.0.0.1:47916)
0812 00:20:37.621197 (+ 1774us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:37.621264 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:37.621476 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:37.623500 (+ 2024us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:37.623506 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:37.623535 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:37.624327 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:37.624344 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.626424 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.626431 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:37.629429 (+ 2998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:37.629446 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.631496 (+ 2050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.631505 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:37.631718 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:37.631752 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:20:37.631824 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 00:20:37.631967 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1478,"mutex_wait_us":257,"spinlock_wait_cycles":17408,"thread_start_us":392,"threads_started":1}
I20260812 00:20:37.633459 20949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:37.619769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47916 (local address 127.18.163.193:36881)
0812 00:20:37.622606 (+ 2837us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:37.622615 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:37.622648 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:20:37.622747 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:37.622756 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:37.623019 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:37.623254 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:37.624553 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.626243 (+ 1690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.629672 (+ 3429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.631219 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.632706 (+ 1487us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:37.632862 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:37.632928 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 00:20:37.633122 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2677,"thread_start_us":2524,"threads_started":1}
I20260812 00:20:37.633481 20951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:37.620739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35344 (local address 127.18.163.195:40085)
0812 00:20:37.622270 (+ 1531us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:37.622281 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:37.622320 (+ 39us) server_negotiation.cc:407] Connection header received
0812 00:20:37.622434 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:37.622446 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:37.622777 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:37.623786 (+ 1009us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:37.624291 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.626209 (+ 1918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.629218 (+ 3009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.630835 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.631079 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:37.632824 (+ 1745us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:37.632925 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 00:20:37.633131 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1319,"thread_start_us":1077,"threads_started":1}
I20260812 00:20:37.635660 20952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:37.622584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:45015 (local address 127.0.0.1:45226)
0812 00:20:37.624933 (+ 2349us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:37.624958 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:37.625079 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:37.626905 (+ 1826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:37.626914 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:37.626954 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:37.627607 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:37.627624 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.629705 (+ 2081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.629711 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:37.631147 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:37.631160 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.633485 (+ 2325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.633492 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:37.634978 (+ 1486us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:37.635009 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 00:20:37.635138 (+ 129us) client_negotiation.cc:240] Negotiation successful
0812 00:20:37.635295 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2212,"thread_start_us":2064,"threads_started":1}
I20260812 00:20:37.635716 20953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:37.623140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45226 (local address 127.18.163.194:45015)
0812 00:20:37.625737 (+ 2597us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:37.625747 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:37.625777 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:20:37.625888 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:37.625896 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:37.626233 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:37.626454 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:37.627921 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.629475 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.631375 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.633225 (+ 1850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.633461 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:37.633687 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:37.635208 (+ 1521us) server_negotiation.cc:299] Negotiation successful
0812 00:20:37.635417 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2397,"thread_start_us":2250,"threads_started":1}
I20260812 00:20:37.638159 20849 tablet_service.cc:1467] Processing CreateTablet for tablet 56556c70241c40dab2c2ab0631963bc5 (DEFAULT_TABLE table=test-table [id=45bc939d5b6144cd977c9145d70288af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:37.639175 20533 tablet_service.cc:1467] Processing CreateTablet for tablet 56556c70241c40dab2c2ab0631963bc5 (DEFAULT_TABLE table=test-table [id=45bc939d5b6144cd977c9145d70288af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:37.639999 20849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56556c70241c40dab2c2ab0631963bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:37.640777 20533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56556c70241c40dab2c2ab0631963bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:37.649190 20690 tablet_service.cc:1467] Processing CreateTablet for tablet 56556c70241c40dab2c2ab0631963bc5 (DEFAULT_TABLE table=test-table [id=45bc939d5b6144cd977c9145d70288af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:37.651147 20690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56556c70241c40dab2c2ab0631963bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:37.658232 20955 tablet_bootstrap.cc:492] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004: Bootstrap starting.
I20260812 00:20:37.661329 20954 tablet_bootstrap.cc:492] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e: Bootstrap starting.
I20260812 00:20:37.664335 20955 tablet_bootstrap.cc:654] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:37.665720 20954 tablet_bootstrap.cc:654] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:37.666011 20955 log.cc:824] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004: Log is configured to *not* fsync() on all Append() calls
I20260812 00:20:37.667244 20954 log.cc:824] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:20:37.669667 20957 tablet_bootstrap.cc:492] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd: Bootstrap starting.
I20260812 00:20:37.670008 20955 tablet_bootstrap.cc:492] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004: No bootstrap required, opened a new log
I20260812 00:20:37.670328 20955 ts_tablet_manager.cc:1397] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260812 00:20:37.671243 20954 tablet_bootstrap.cc:492] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e: No bootstrap required, opened a new log
I20260812 00:20:37.671561 20954 ts_tablet_manager.cc:1397] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260812 00:20:37.673923 20957 tablet_bootstrap.cc:654] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:37.675520 20957 log.cc:824] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd: Log is configured to *not* fsync() on all Append() calls
I20260812 00:20:37.679433 20957 tablet_bootstrap.cc:492] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd: No bootstrap required, opened a new log
I20260812 00:20:37.679106 20955 raft_consensus.cc:348] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } }
I20260812 00:20:37.679802 20955 raft_consensus.cc:374] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:37.679842 20957 ts_tablet_manager.cc:1397] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260812 00:20:37.680011 20955 raft_consensus.cc:729] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78acbff041394e8db7ffccda3ae26004, State: Initialized, Role: FOLLOWER
I20260812 00:20:37.681054 20955 consensus_queue.cc:260] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } }
I20260812 00:20:37.682761 20954 raft_consensus.cc:348] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } }
I20260812 00:20:37.683358 20954 raft_consensus.cc:374] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:37.683508 20954 raft_consensus.cc:729] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8efe2ab4f75c465d808352336ada3e6e, State: Initialized, Role: FOLLOWER
I20260812 00:20:37.684296 20955 ts_tablet_manager.cc:1428] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004: Time spent starting tablet: real 0.014s user 0.009s sys 0.003s
I20260812 00:20:37.684429 20954 consensus_queue.cc:260] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } }
I20260812 00:20:37.685868 20934 heartbeater.cc:503] Master 127.18.163.254:43257 was elected leader, sending a full tablet report...
I20260812 00:20:37.686614 20954 ts_tablet_manager.cc:1428] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260812 00:20:37.691213 20957 raft_consensus.cc:348] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } }
I20260812 00:20:37.691730 20957 raft_consensus.cc:374] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:37.691835 20957 raft_consensus.cc:729] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e8a65f13b14fff85554fdf2439b2fd, State: Initialized, Role: FOLLOWER
I20260812 00:20:37.692402 20957 consensus_queue.cc:260] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } }
I20260812 00:20:37.693714 20771 heartbeater.cc:503] Master 127.18.163.254:43257 was elected leader, sending a full tablet report...
I20260812 00:20:37.694519 20957 ts_tablet_manager.cc:1428] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd: Time spent starting tablet: real 0.015s user 0.006s sys 0.008s
W20260812 00:20:37.767015 20935 tablet.cc:2369] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:20:37.835208 20962 raft_consensus.cc:482] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:20:37.835569 20962 raft_consensus.cc:504] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } }
I20260812 00:20:37.837291 20962 leader_election.cc:288] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78acbff041394e8db7ffccda3ae26004 (127.18.163.193:36881), 8efe2ab4f75c465d808352336ada3e6e (127.18.163.195:40085)
W20260812 00:20:37.840678 20613 tablet.cc:2369] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:20:37.847163 20949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:37.837872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:45579 (local address 127.18.163.193:36881)
0812 00:20:37.838128 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:37.838134 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:37.839017 (+ 883us) server_negotiation.cc:407] Connection header received
0812 00:20:37.839177 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:37.839183 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:37.839272 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:37.839380 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:37.840388 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.841522 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.844472 (+ 2950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.845849 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.846019 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:37.846115 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:37.846729 (+ 614us) server_negotiation.cc:299] Negotiation successful
0812 00:20:37.846880 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:20:37.847172 20951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:37.838004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:34337 (local address 127.18.163.195:40085)
0812 00:20:37.838230 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:37.838238 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:37.838928 (+ 690us) server_negotiation.cc:407] Connection header received
0812 00:20:37.839178 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:37.839184 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:37.839272 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:37.839380 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:37.840422 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.841256 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.844465 (+ 3209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.845817 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.846019 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:37.846104 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:37.846729 (+ 625us) server_negotiation.cc:299] Negotiation successful
0812 00:20:37.846880 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:20:37.847429 20965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:37.837669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:40085 (local address 127.18.163.194:34337)
0812 00:20:37.838760 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:37.838790 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:37.838988 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:37.839420 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:37.839425 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:37.839465 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:37.840245 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:37.840258 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.841419 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.841426 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:37.844242 (+ 2816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:37.844263 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.846154 (+ 1891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.846160 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:37.846474 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:37.846561 (+ 87us) client_negotiation.cc:769] Sending connection context
0812 00:20:37.846675 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 00:20:37.846868 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":930,"mutex_wait_us":329,"spinlock_wait_cycles":1280,"thread_start_us":812,"threads_started":1}
I20260812 00:20:37.847497 20963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:37.837750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:36881 (local address 127.18.163.194:45579)
0812 00:20:37.838905 (+ 1155us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:37.838923 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:37.839038 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:37.839420 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:37.839425 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:37.839472 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:37.840133 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:37.840155 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.841687 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.841692 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:37.844242 (+ 2550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:37.844263 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.846153 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.846160 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:37.846470 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:37.846563 (+ 93us) client_negotiation.cc:769] Sending connection context
0812 00:20:37.846675 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 00:20:37.846868 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":985,"mutex_wait_us":189,"spinlock_wait_cycles":7680,"thread_start_us":579,"threads_started":1}
I20260812 00:20:37.848906 20559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56556c70241c40dab2c2ab0631963bc5" candidate_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78acbff041394e8db7ffccda3ae26004" is_pre_election: true
I20260812 00:20:37.848906 20878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56556c70241c40dab2c2ab0631963bc5" candidate_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8efe2ab4f75c465d808352336ada3e6e" is_pre_election: true
I20260812 00:20:37.849617 20559 raft_consensus.cc:2454] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e8a65f13b14fff85554fdf2439b2fd in term 0.
I20260812 00:20:37.849609 20878 raft_consensus.cc:2454] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e8a65f13b14fff85554fdf2439b2fd in term 0.
I20260812 00:20:37.850471 20633 leader_election.cc:302] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 78acbff041394e8db7ffccda3ae26004, 8efe2ab4f75c465d808352336ada3e6e, e1e8a65f13b14fff85554fdf2439b2fd; no voters:
I20260812 00:20:37.851082 20962 raft_consensus.cc:2781] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:20:37.851263 20962 raft_consensus.cc:482] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:20:37.851385 20962 raft_consensus.cc:3037] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:37.853865 20962 raft_consensus.cc:504] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } }
I20260812 00:20:37.854569 20962 leader_election.cc:288] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [CANDIDATE]: Term 1 election: Requested vote from peers 78acbff041394e8db7ffccda3ae26004 (127.18.163.193:36881), 8efe2ab4f75c465d808352336ada3e6e (127.18.163.195:40085)
I20260812 00:20:37.855154 20559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56556c70241c40dab2c2ab0631963bc5" candidate_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78acbff041394e8db7ffccda3ae26004"
I20260812 00:20:37.855165 20878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56556c70241c40dab2c2ab0631963bc5" candidate_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8efe2ab4f75c465d808352336ada3e6e"
I20260812 00:20:37.855396 20878 raft_consensus.cc:3037] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:37.855397 20559 raft_consensus.cc:3037] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:37.857935 20559 raft_consensus.cc:2454] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e8a65f13b14fff85554fdf2439b2fd in term 1.
I20260812 00:20:37.858268 20878 raft_consensus.cc:2454] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e8a65f13b14fff85554fdf2439b2fd in term 1.
I20260812 00:20:37.858614 20633 leader_election.cc:302] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78acbff041394e8db7ffccda3ae26004, e1e8a65f13b14fff85554fdf2439b2fd; no voters:
I20260812 00:20:37.858995 20962 raft_consensus.cc:2781] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:20:37.859513 20962 raft_consensus.cc:686] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [term 1 LEADER]: Becoming Leader. State: Replica: e1e8a65f13b14fff85554fdf2439b2fd, State: Running, Role: LEADER
I20260812 00:20:37.860044 20962 consensus_queue.cc:237] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } }
I20260812 00:20:37.865221 20374 catalog_manager.cc:5495] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e8a65f13b14fff85554fdf2439b2fd (127.18.163.194). New cstate: current_term: 1 leader_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } health_report { overall_health: HEALTHY } } }
W20260812 00:20:37.919874 20772 tablet.cc:2369] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:20:37.948064 20953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:37.941343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45228 (local address 127.18.163.194:45015)
0812 00:20:37.941649 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:37.941657 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:37.941753 (+ 96us) server_negotiation.cc:407] Connection header received
0812 00:20:37.942050 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:37.942054 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:37.942138 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:37.942267 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:20:37.942673 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.943403 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.945287 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:37.945808 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:37.945910 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:37.946721 (+ 811us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:20:37.947315 (+ 594us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:20:37.947445 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:37.947653 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 00:20:37.947740 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260812 00:20:37.960196 20559 raft_consensus.cc:1261] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004 [term 1 FOLLOWER]: Refusing update from remote peer e1e8a65f13b14fff85554fdf2439b2fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:20:37.960290 20878 raft_consensus.cc:1261] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e [term 1 FOLLOWER]: Refusing update from remote peer e1e8a65f13b14fff85554fdf2439b2fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:20:37.961895 20967 consensus_queue.cc:1035] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:20:37.962463 20962 consensus_queue.cc:1035] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:20:37.978952 20974 mvcc.cc:205] Tried to move back new op lower bound from 7317479579470618624 to 7317479579079376896. Current Snapshot: MvccSnapshot[applied={T|T < 7317479579470618624}]
I20260812 00:20:38.000602 20373 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:20:38.000939 20373 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:20:38.005436 20373 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb: Sending DeleteTablet for 3 replicas of tablet 56556c70241c40dab2c2ab0631963bc5
I20260812 00:20:38.007045 20533 tablet_service.cc:1514] Processing DeleteTablet for tablet 56556c70241c40dab2c2ab0631963bc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:37 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:47916
I20260812 00:20:38.006971 20849 tablet_service.cc:1514] Processing DeleteTablet for tablet 56556c70241c40dab2c2ab0631963bc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:37 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:35344
I20260812 00:20:38.007282 20690 tablet_service.cc:1514] Processing DeleteTablet for tablet 56556c70241c40dab2c2ab0631963bc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:37 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:45226
I20260812 00:20:38.015442 20373 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47420:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:20:38.017391 20373 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:20:38.019820 20985 tablet_replica.cc:330] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd: stopping tablet replica
I20260812 00:20:38.020947 20983 tablet_replica.cc:330] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e: stopping tablet replica
I20260812 00:20:38.021459 20985 raft_consensus.cc:2229] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:20:38.021636 20984 tablet_replica.cc:330] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004: stopping tablet replica
I20260812 00:20:38.022239 20983 raft_consensus.cc:2229] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:20:38.022773 20984 raft_consensus.cc:2229] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:20:38.022908 20985 raft_consensus.cc:2258] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:20:38.024166 20983 raft_consensus.cc:2258] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:20:38.024426 20984 raft_consensus.cc:2258] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:20:38.025452 20985 ts_tablet_manager.cc:1905] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:20:38.028106 20984 ts_tablet_manager.cc:1905] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:20:38.028971 20849 tablet_service.cc:1467] Processing CreateTablet for tablet 92b2d53a07f044d380937939caee4c90 (DEFAULT_TABLE table=test-table [id=32510001074f4e81939eebafdee2e37b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:38.029631 20849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92b2d53a07f044d380937939caee4c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:38.029512 20690 tablet_service.cc:1467] Processing CreateTablet for tablet 92b2d53a07f044d380937939caee4c90 (DEFAULT_TABLE table=test-table [id=32510001074f4e81939eebafdee2e37b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:38.030112 20690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92b2d53a07f044d380937939caee4c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:38.033991 20985 ts_tablet_manager.cc:1918] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:20:38.034318 20985 log.cc:1196] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/56556c70241c40dab2c2ab0631963bc5
I20260812 00:20:38.035087 20985 ts_tablet_manager.cc:1939] T 56556c70241c40dab2c2ab0631963bc5 P e1e8a65f13b14fff85554fdf2439b2fd: Deleting consensus metadata
I20260812 00:20:38.037067 20983 ts_tablet_manager.cc:1905] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:20:38.028973 20533 tablet_service.cc:1467] Processing CreateTablet for tablet 92b2d53a07f044d380937939caee4c90 (DEFAULT_TABLE table=test-table [id=32510001074f4e81939eebafdee2e37b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:38.037425 20354 catalog_manager.cc:4841] TS e1e8a65f13b14fff85554fdf2439b2fd (127.18.163.194:45015): tablet 56556c70241c40dab2c2ab0631963bc5 (table test-table [id=45bc939d5b6144cd977c9145d70288af]) successfully deleted
I20260812 00:20:38.037752 20533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92b2d53a07f044d380937939caee4c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:38.037842 20957 tablet_bootstrap.cc:492] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd: Bootstrap starting.
I20260812 00:20:38.040078 20957 tablet_bootstrap.cc:654] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:38.040584 20954 tablet_bootstrap.cc:492] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e: Bootstrap starting.
I20260812 00:20:38.042688 20954 tablet_bootstrap.cc:654] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:38.046065 20983 ts_tablet_manager.cc:1918] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:20:38.046322 20983 log.cc:1196] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/56556c70241c40dab2c2ab0631963bc5
I20260812 00:20:38.046937 20983 ts_tablet_manager.cc:1939] T 56556c70241c40dab2c2ab0631963bc5 P 8efe2ab4f75c465d808352336ada3e6e: Deleting consensus metadata
I20260812 00:20:38.049213 20359 catalog_manager.cc:4841] TS 8efe2ab4f75c465d808352336ada3e6e (127.18.163.195:40085): tablet 56556c70241c40dab2c2ab0631963bc5 (table test-table [id=45bc939d5b6144cd977c9145d70288af]) successfully deleted
I20260812 00:20:38.052668 20955 tablet_bootstrap.cc:492] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004: Bootstrap starting.
I20260812 00:20:38.055145 20955 tablet_bootstrap.cc:654] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:38.057380 20957 tablet_bootstrap.cc:492] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd: No bootstrap required, opened a new log
I20260812 00:20:38.057698 20957 ts_tablet_manager.cc:1397] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.003s
I20260812 00:20:38.059082 20957 raft_consensus.cc:348] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.059623 20957 raft_consensus.cc:374] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:38.059820 20957 raft_consensus.cc:729] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e8a65f13b14fff85554fdf2439b2fd, State: Initialized, Role: FOLLOWER
I20260812 00:20:38.060331 20957 consensus_queue.cc:260] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.062179 20957 ts_tablet_manager.cc:1428] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260812 00:20:38.062474 20984 ts_tablet_manager.cc:1918] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:20:38.062693 20984 log.cc:1196] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/56556c70241c40dab2c2ab0631963bc5
I20260812 00:20:38.063362 20984 ts_tablet_manager.cc:1939] T 56556c70241c40dab2c2ab0631963bc5 P 78acbff041394e8db7ffccda3ae26004: Deleting consensus metadata
I20260812 00:20:38.065476 20354 catalog_manager.cc:4841] TS 78acbff041394e8db7ffccda3ae26004 (127.18.163.193:36881): tablet 56556c70241c40dab2c2ab0631963bc5 (table test-table [id=45bc939d5b6144cd977c9145d70288af]) successfully deleted
I20260812 00:20:38.067040 20955 tablet_bootstrap.cc:492] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004: No bootstrap required, opened a new log
I20260812 00:20:38.067193 20954 tablet_bootstrap.cc:492] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e: No bootstrap required, opened a new log
I20260812 00:20:38.067274 20955 ts_tablet_manager.cc:1397] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.000s
I20260812 00:20:38.067381 20954 ts_tablet_manager.cc:1397] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.007s
I20260812 00:20:38.068073 20955 raft_consensus.cc:348] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.068306 20955 raft_consensus.cc:374] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:38.068409 20955 raft_consensus.cc:729] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78acbff041394e8db7ffccda3ae26004, State: Initialized, Role: FOLLOWER
I20260812 00:20:38.068267 20954 raft_consensus.cc:348] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.068516 20954 raft_consensus.cc:374] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:38.068622 20954 raft_consensus.cc:729] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8efe2ab4f75c465d808352336ada3e6e, State: Initialized, Role: FOLLOWER
I20260812 00:20:38.068729 20955 consensus_queue.cc:260] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.068917 20954 consensus_queue.cc:260] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.069427 20955 ts_tablet_manager.cc:1428] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260812 00:20:38.070322 20954 ts_tablet_manager.cc:1428] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 00:20:38.234975 20961 raft_consensus.cc:482] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:20:38.235297 20961 raft_consensus.cc:504] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.237471 20961 leader_election.cc:288] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78acbff041394e8db7ffccda3ae26004 (127.18.163.193:36881), e1e8a65f13b14fff85554fdf2439b2fd (127.18.163.194:45015)
I20260812 00:20:38.243623 20962 raft_consensus.cc:482] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:20:38.243860 20962 raft_consensus.cc:504] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.244686 20962 leader_election.cc:288] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78acbff041394e8db7ffccda3ae26004 (127.18.163.193:36881), 8efe2ab4f75c465d808352336ada3e6e (127.18.163.195:40085)
I20260812 00:20:38.245713 20559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b2d53a07f044d380937939caee4c90" candidate_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78acbff041394e8db7ffccda3ae26004" is_pre_election: true
I20260812 00:20:38.245990 20559 raft_consensus.cc:2454] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e8a65f13b14fff85554fdf2439b2fd in term 0.
I20260812 00:20:38.246165 20949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.237972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:50311 (local address 127.18.163.193:36881)
0812 00:20:38.238200 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:38.238208 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:38.238666 (+ 458us) server_negotiation.cc:407] Connection header received
0812 00:20:38.239030 (+ 364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:38.239038 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:38.239146 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:38.239225 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:38.240033 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.241235 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.243515 (+ 2280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.244829 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.245019 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.245107 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:38.245696 (+ 589us) server_negotiation.cc:299] Negotiation successful
0812 00:20:38.245847 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:20:38.246552 20633 leader_election.cc:302] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78acbff041394e8db7ffccda3ae26004, e1e8a65f13b14fff85554fdf2439b2fd; no voters:
I20260812 00:20:38.246903 20962 raft_consensus.cc:2781] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:20:38.247045 20962 raft_consensus.cc:482] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:20:38.247179 20962 raft_consensus.cc:3037] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:38.247354 20989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.237830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:36881 (local address 127.18.163.195:50311)
0812 00:20:38.238553 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:38.238575 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:38.238807 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:38.239472 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:38.239478 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:38.239514 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:38.239828 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:38.239844 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.241404 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.241410 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:38.243243 (+ 1833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:38.243259 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.245228 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.245235 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:38.245419 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.245464 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 00:20:38.246385 (+ 921us) client_negotiation.cc:240] Negotiation successful
0812 00:20:38.246574 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"mutex_wait_us":3,"thread_start_us":378,"threads_started":1}
I20260812 00:20:38.248133 20878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b2d53a07f044d380937939caee4c90" candidate_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8efe2ab4f75c465d808352336ada3e6e" is_pre_election: true
I20260812 00:20:38.248283 20953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.238880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:34237 (local address 127.18.163.194:45015)
0812 00:20:38.239105 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:38.239111 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:38.239802 (+ 691us) server_negotiation.cc:407] Connection header received
0812 00:20:38.239988 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:38.239993 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:38.240092 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:38.240204 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:38.240792 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.241863 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.244706 (+ 2843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.246119 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.246265 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.246351 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:38.247740 (+ 1389us) server_negotiation.cc:299] Negotiation successful
0812 00:20:38.247924 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 00:20:38.248409 20878 raft_consensus.cc:2454] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e8a65f13b14fff85554fdf2439b2fd in term 0.
I20260812 00:20:38.249366 20990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.238718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:45015 (local address 127.18.163.195:34237)
0812 00:20:38.239650 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:38.239670 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:38.239822 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:38.240227 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:38.240231 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:38.240259 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:38.240587 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:38.240597 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.242044 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.242051 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:38.244463 (+ 2412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:38.244482 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.246888 (+ 2406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.246895 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:38.247284 (+ 389us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.247342 (+ 58us) client_negotiation.cc:769] Sending connection context
0812 00:20:38.248812 (+ 1470us) client_negotiation.cc:240] Negotiation successful
0812 00:20:38.249006 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":775,"thread_start_us":573,"threads_started":1}
I20260812 00:20:38.249461 20559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b2d53a07f044d380937939caee4c90" candidate_uuid: "8efe2ab4f75c465d808352336ada3e6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78acbff041394e8db7ffccda3ae26004" is_pre_election: true
I20260812 00:20:38.249776 20559 raft_consensus.cc:2454] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8efe2ab4f75c465d808352336ada3e6e in term 0.
I20260812 00:20:38.250460 20794 leader_election.cc:302] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78acbff041394e8db7ffccda3ae26004, 8efe2ab4f75c465d808352336ada3e6e; no voters:
I20260812 00:20:38.250561 20716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b2d53a07f044d380937939caee4c90" candidate_uuid: "8efe2ab4f75c465d808352336ada3e6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" is_pre_election: true
I20260812 00:20:38.251034 20961 raft_consensus.cc:2781] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:20:38.251174 20961 raft_consensus.cc:482] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:20:38.251277 20961 raft_consensus.cc:3037] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:38.251454 20962 raft_consensus.cc:504] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.252031 20716 raft_consensus.cc:2379] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8efe2ab4f75c465d808352336ada3e6e in current term 1: Already voted for candidate e1e8a65f13b14fff85554fdf2439b2fd in this term.
I20260812 00:20:38.252785 20962 leader_election.cc:288] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [CANDIDATE]: Term 1 election: Requested vote from peers 78acbff041394e8db7ffccda3ae26004 (127.18.163.193:36881), 8efe2ab4f75c465d808352336ada3e6e (127.18.163.195:40085)
I20260812 00:20:38.252765 20559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b2d53a07f044d380937939caee4c90" candidate_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78acbff041394e8db7ffccda3ae26004"
I20260812 00:20:38.252996 20559 raft_consensus.cc:3037] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:38.254773 20961 raft_consensus.cc:504] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.255245 20878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b2d53a07f044d380937939caee4c90" candidate_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8efe2ab4f75c465d808352336ada3e6e"
I20260812 00:20:38.255561 20878 raft_consensus.cc:2379] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e1e8a65f13b14fff85554fdf2439b2fd in current term 1: Already voted for candidate 8efe2ab4f75c465d808352336ada3e6e in this term.
I20260812 00:20:38.256160 20559 raft_consensus.cc:2454] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e8a65f13b14fff85554fdf2439b2fd in term 1.
I20260812 00:20:38.256314 20558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b2d53a07f044d380937939caee4c90" candidate_uuid: "8efe2ab4f75c465d808352336ada3e6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78acbff041394e8db7ffccda3ae26004"
I20260812 00:20:38.256728 20558 raft_consensus.cc:2379] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8efe2ab4f75c465d808352336ada3e6e in current term 1: Already voted for candidate e1e8a65f13b14fff85554fdf2439b2fd in this term.
I20260812 00:20:38.256668 20633 leader_election.cc:302] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78acbff041394e8db7ffccda3ae26004, e1e8a65f13b14fff85554fdf2439b2fd; no voters:
I20260812 00:20:38.255558 20961 leader_election.cc:288] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [CANDIDATE]: Term 1 election: Requested vote from peers 78acbff041394e8db7ffccda3ae26004 (127.18.163.193:36881), e1e8a65f13b14fff85554fdf2439b2fd (127.18.163.194:45015)
I20260812 00:20:38.257252 20716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b2d53a07f044d380937939caee4c90" candidate_uuid: "8efe2ab4f75c465d808352336ada3e6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e8a65f13b14fff85554fdf2439b2fd"
I20260812 00:20:38.257283 20962 raft_consensus.cc:2781] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:20:38.257718 20962 raft_consensus.cc:686] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [term 1 LEADER]: Becoming Leader. State: Replica: e1e8a65f13b14fff85554fdf2439b2fd, State: Running, Role: LEADER
I20260812 00:20:38.258055 20962 consensus_queue.cc:237] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.261003 20794 leader_election.cc:302] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8efe2ab4f75c465d808352336ada3e6e; no voters: 78acbff041394e8db7ffccda3ae26004, e1e8a65f13b14fff85554fdf2439b2fd
I20260812 00:20:38.261425 20961 raft_consensus.cc:2726] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 00:20:38.262086 20374 catalog_manager.cc:5495] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e8a65f13b14fff85554fdf2439b2fd (127.18.163.194). New cstate: current_term: 1 leader_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } health_report { overall_health: UNKNOWN } } }
Aug 12 00:20:38 dist-test-slave-njxd krb5kdc[20316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494035, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:38.346462 20998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.328514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:43257 (local address 127.0.0.1:47432)
0812 00:20:38.329308 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:38.329337 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:38.329553 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:38.329979 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:38.329984 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:38.330741 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:38.330979 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:38.330989 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.332140 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.332146 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:38.333102 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:38.333114 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.333945 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.333951 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:38.334121 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.334951 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:38.334976 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:38.338439 (+ 3463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:38.342952 (+ 4513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:38.342972 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:38.342980 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:38.343720 (+ 740us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:38.344209 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:38.344215 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:38.344219 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:38.344436 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:38.345122 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:38.345132 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:38.345368 (+ 236us) client_negotiation.cc:769] Sending connection context
0812 00:20:38.345617 (+ 249us) client_negotiation.cc:240] Negotiation successful
0812 00:20:38.346005 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":406,"threads_started":1}
I20260812 00:20:38.347177 21000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.328584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47432 (local address 127.18.163.254:43257)
0812 00:20:38.329674 (+ 1090us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:38.329679 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:38.329705 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:20:38.329761 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:38.329764 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:38.329827 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:38.329949 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:38.331173 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.331965 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.333256 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.333761 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.333897 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.338714 (+ 4817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:38.338721 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:38.338727 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:38.338770 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:38.342751 (+ 3981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:38.343880 (+ 1129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:38.343886 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:38.343890 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:38.344064 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:38.344580 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:38.344585 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:38.344589 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:38.344950 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:38.345100 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:38.345757 (+ 657us) server_negotiation.cc:299] Negotiation successful
0812 00:20:38.346203 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":165,"server-negotiator.queue_time_us":925,"thread_start_us":765,"threads_started":1}
I20260812 00:20:38.354327 20374 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:47432:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 00:20:38.355732 20374 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:20:38.364491 20533 tablet_service.cc:1467] Processing CreateTablet for tablet bec858bdc607423bad0f7a523fd8c044 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=66e90f0464864e38938351c161c61284]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:20:38.364789 20690 tablet_service.cc:1467] Processing CreateTablet for tablet bec858bdc607423bad0f7a523fd8c044 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=66e90f0464864e38938351c161c61284]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:20:38.365212 20533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bec858bdc607423bad0f7a523fd8c044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:38.365306 20690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bec858bdc607423bad0f7a523fd8c044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:38.372629 20957 tablet_bootstrap.cc:492] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd: Bootstrap starting.
I20260812 00:20:38.373304 20955 tablet_bootstrap.cc:492] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004: Bootstrap starting.
I20260812 00:20:38.373306 20849 tablet_service.cc:1467] Processing CreateTablet for tablet bec858bdc607423bad0f7a523fd8c044 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=66e90f0464864e38938351c161c61284]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:20:38.374022 20849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bec858bdc607423bad0f7a523fd8c044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:38.374861 20957 tablet_bootstrap.cc:654] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:38.375335 20955 tablet_bootstrap.cc:654] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:38.383539 20954 tablet_bootstrap.cc:492] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e: Bootstrap starting.
I20260812 00:20:38.385715 20954 tablet_bootstrap.cc:654] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:38.386816 20957 tablet_bootstrap.cc:492] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd: No bootstrap required, opened a new log
I20260812 00:20:38.387166 20957 ts_tablet_manager.cc:1397] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.004s
I20260812 00:20:38.387954 20957 raft_consensus.cc:348] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.388222 20957 raft_consensus.cc:374] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:38.388336 20957 raft_consensus.cc:729] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e8a65f13b14fff85554fdf2439b2fd, State: Initialized, Role: FOLLOWER
I20260812 00:20:38.388749 20957 consensus_queue.cc:260] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.389392 20962 tablet_replica.cc:439] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } }
I20260812 00:20:38.389667 20957 ts_tablet_manager.cc:1428] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:20:38.389827 20962 tablet_replica.cc:442] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:20:38.394925 20955 tablet_bootstrap.cc:492] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004: No bootstrap required, opened a new log
I20260812 00:20:38.395179 20955 ts_tablet_manager.cc:1397] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.000s
I20260812 00:20:38.396072 20955 raft_consensus.cc:348] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.396373 20955 raft_consensus.cc:374] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:38.396406 20954 tablet_bootstrap.cc:492] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e: No bootstrap required, opened a new log
I20260812 00:20:38.396476 20955 raft_consensus.cc:729] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78acbff041394e8db7ffccda3ae26004, State: Initialized, Role: FOLLOWER
I20260812 00:20:38.396605 20954 ts_tablet_manager.cc:1397] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.004s
I20260812 00:20:38.396762 20955 consensus_queue.cc:260] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.397420 20955 ts_tablet_manager.cc:1428] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:20:38.397596 20954 raft_consensus.cc:348] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.397909 20954 raft_consensus.cc:374] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:38.398020 20954 raft_consensus.cc:729] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8efe2ab4f75c465d808352336ada3e6e, State: Initialized, Role: FOLLOWER
I20260812 00:20:38.397842 20960 tablet_replica.cc:439] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } }
I20260812 00:20:38.398278 20960 tablet_replica.cc:442] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:20:38.398309 20954 consensus_queue.cc:260] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.398814 20961 tablet_replica.cc:439] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } }
I20260812 00:20:38.399134 20961 tablet_replica.cc:442] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:20:38.400400 20954 ts_tablet_manager.cc:1428] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260812 00:20:38.403137 20960 raft_consensus.cc:482] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:20:38.403363 20960 raft_consensus.cc:504] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.405021 20960 leader_election.cc:288] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e8a65f13b14fff85554fdf2439b2fd (127.18.163.194:45015), 8efe2ab4f75c465d808352336ada3e6e (127.18.163.195:40085)
I20260812 00:20:38.418606 20953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.405946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:36529 (local address 127.18.163.194:45015)
0812 00:20:38.406137 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:38.406141 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:38.411363 (+ 5222us) server_negotiation.cc:407] Connection header received
0812 00:20:38.411726 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:38.411735 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:38.411823 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:38.411925 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:38.412922 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.414104 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.416272 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.417424 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.417712 (+ 288us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.417794 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:38.418138 (+ 344us) server_negotiation.cc:299] Negotiation successful
0812 00:20:38.418291 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 00:20:38.418751 21004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.405372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:45015 (local address 127.18.163.193:36529)
0812 00:20:38.411242 (+ 5870us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:38.411265 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:38.411488 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:38.412117 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:38.412122 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:38.412187 (+ 65us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:38.412723 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:38.412735 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.414250 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.414260 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:38.416049 (+ 1789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:38.416068 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.417731 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.417738 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:38.417945 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.417981 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:20:38.418092 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 00:20:38.418256 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5736,"mutex_wait_us":93,"spinlock_wait_cycles":2816,"thread_start_us":5067,"threads_started":1}
I20260812 00:20:38.419749 21005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.405348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:40085 (local address 127.18.163.193:57269)
0812 00:20:38.410824 (+ 5476us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:38.410852 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:38.411057 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:38.411948 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:38.411952 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:38.411990 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:38.412375 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:38.412386 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.414129 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.414136 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:38.416601 (+ 2465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:38.416620 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.418716 (+ 2096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.418724 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:38.418930 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.418964 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:20:38.419080 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 00:20:38.419242 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5293,"mutex_wait_us":41,"spinlock_wait_cycles":2816,"thread_start_us":5561,"threads_started":1}
I20260812 00:20:38.419791 20716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bec858bdc607423bad0f7a523fd8c044" candidate_uuid: "78acbff041394e8db7ffccda3ae26004" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" is_pre_election: true
I20260812 00:20:38.420176 20716 raft_consensus.cc:2454] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78acbff041394e8db7ffccda3ae26004 in term 0.
I20260812 00:20:38.420814 20475 leader_election.cc:302] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78acbff041394e8db7ffccda3ae26004, e1e8a65f13b14fff85554fdf2439b2fd; no voters:
I20260812 00:20:38.421356 20960 raft_consensus.cc:2781] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:20:38.421479 20960 raft_consensus.cc:482] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:20:38.421665 20960 raft_consensus.cc:3037] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:38.421768 21006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.405843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:57269 (local address 127.18.163.195:40085)
0812 00:20:38.411664 (+ 5821us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:38.411669 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:38.411684 (+ 15us) server_negotiation.cc:407] Connection header received
0812 00:20:38.411742 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:38.411746 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:38.411804 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:38.411925 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:38.412579 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.413952 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.416855 (+ 2903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.418248 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.418432 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.418511 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:38.420826 (+ 2315us) server_negotiation.cc:299] Negotiation successful
0812 00:20:38.421014 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5659,"thread_start_us":5498,"threads_started":1}
I20260812 00:20:38.422456 20878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bec858bdc607423bad0f7a523fd8c044" candidate_uuid: "78acbff041394e8db7ffccda3ae26004" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8efe2ab4f75c465d808352336ada3e6e" is_pre_election: true
I20260812 00:20:38.422716 20878 raft_consensus.cc:2454] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78acbff041394e8db7ffccda3ae26004 in term 0.
I20260812 00:20:38.424609 20960 raft_consensus.cc:504] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.425308 20960 leader_election.cc:288] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [CANDIDATE]: Term 1 election: Requested vote from peers e1e8a65f13b14fff85554fdf2439b2fd (127.18.163.194:45015), 8efe2ab4f75c465d808352336ada3e6e (127.18.163.195:40085)
I20260812 00:20:38.425902 20878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bec858bdc607423bad0f7a523fd8c044" candidate_uuid: "78acbff041394e8db7ffccda3ae26004" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8efe2ab4f75c465d808352336ada3e6e"
I20260812 00:20:38.425927 20716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bec858bdc607423bad0f7a523fd8c044" candidate_uuid: "78acbff041394e8db7ffccda3ae26004" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e8a65f13b14fff85554fdf2439b2fd"
I20260812 00:20:38.426191 20878 raft_consensus.cc:3037] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:38.426249 20716 raft_consensus.cc:3037] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:38.428509 20878 raft_consensus.cc:2454] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78acbff041394e8db7ffccda3ae26004 in term 1.
I20260812 00:20:38.428995 20480 leader_election.cc:302] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78acbff041394e8db7ffccda3ae26004, 8efe2ab4f75c465d808352336ada3e6e; no voters:
I20260812 00:20:38.429376 20960 raft_consensus.cc:2781] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:20:38.429661 20716 raft_consensus.cc:2454] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78acbff041394e8db7ffccda3ae26004 in term 1.
I20260812 00:20:38.430022 20960 raft_consensus.cc:686] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [term 1 LEADER]: Becoming Leader. State: Replica: 78acbff041394e8db7ffccda3ae26004, State: Running, Role: LEADER
I20260812 00:20:38.430491 20960 consensus_queue.cc:237] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } }
I20260812 00:20:38.432857 21007 tablet_replica.cc:439] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004: TxnStatusTablet state changed. Reason: New leader 78acbff041394e8db7ffccda3ae26004. Latest consensus state: current_term: 1 leader_uuid: "78acbff041394e8db7ffccda3ae26004" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } }
I20260812 00:20:38.433350 21007 tablet_replica.cc:442] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:20:38.434597 21009 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 00:20:38.434924 21009 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 00:20:38.434903 20373 catalog_manager.cc:5495] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78acbff041394e8db7ffccda3ae26004 (127.18.163.193). New cstate: current_term: 1 leader_uuid: "78acbff041394e8db7ffccda3ae26004" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } health_report { overall_health: UNKNOWN } } }
I20260812 00:20:38.470396 20949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.462056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47920 (local address 127.18.163.193:36881)
0812 00:20:38.462299 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:38.462306 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:38.462593 (+ 287us) server_negotiation.cc:407] Connection header received
0812 00:20:38.462935 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:38.462942 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:38.463095 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:38.463269 (+ 174us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:20:38.463709 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.464954 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.467029 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.467733 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.467888 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.468641 (+ 753us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:20:38.469504 (+ 863us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:20:38.469729 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:38.469889 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 00:20:38.470001 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 00:20:38.470388 20998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.462075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:36881 (local address 127.0.0.1:47920)
0812 00:20:38.462473 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:38.462496 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:38.462679 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:38.463312 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:38.463317 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:38.463331 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:20:38.463545 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:38.463558 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.465151 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.465158 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:38.466837 (+ 1679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:38.466858 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.468034 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.468041 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:38.468285 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.468387 (+ 102us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:20:38.469679 (+ 1292us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:20:38.469714 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 00:20:38.469833 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 00:20:38.470038 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225}
I20260812 00:20:38.476197 20878 raft_consensus.cc:1261] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e [term 1 FOLLOWER]: Refusing update from remote peer 78acbff041394e8db7ffccda3ae26004: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:20:38.476744 20716 raft_consensus.cc:1261] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd [term 1 FOLLOWER]: Refusing update from remote peer 78acbff041394e8db7ffccda3ae26004: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:20:38.477240 21007 consensus_queue.cc:1035] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:20:38.478523 21007 consensus_queue.cc:1035] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:20:38.501981 20961 tablet_replica.cc:439] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e: TxnStatusTablet state changed. Reason: New leader 78acbff041394e8db7ffccda3ae26004. Latest consensus state: current_term: 1 leader_uuid: "78acbff041394e8db7ffccda3ae26004" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } }
I20260812 00:20:38.502373 20961 tablet_replica.cc:442] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:20:38.503113 20962 tablet_replica.cc:439] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd: TxnStatusTablet state changed. Reason: New leader 78acbff041394e8db7ffccda3ae26004. Latest consensus state: current_term: 1 leader_uuid: "78acbff041394e8db7ffccda3ae26004" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } }
I20260812 00:20:38.503479 20962 tablet_replica.cc:442] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:20:38.505020 20972 mvcc.cc:205] Tried to move back new op lower bound from 7317479581590061056 to 7317479581415415808. Current Snapshot: MvccSnapshot[applied={T|T < 7317479581590061056}]
I20260812 00:20:38.514820 21007 tablet_replica.cc:439] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "78acbff041394e8db7ffccda3ae26004" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } }
I20260812 00:20:38.515201 21007 tablet_replica.cc:442] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:20:38.515586 21007 tablet_replica.cc:439] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "78acbff041394e8db7ffccda3ae26004" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } }
I20260812 00:20:38.515872 21007 tablet_replica.cc:442] T bec858bdc607423bad0f7a523fd8c044 P 78acbff041394e8db7ffccda3ae26004: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:20:38.520222 21013 mvcc.cc:205] Tried to move back new op lower bound from 7317479581590061056 to 7317479581415415808. Current Snapshot: MvccSnapshot[applied={T|T < 7317479581590061056}]
I20260812 00:20:38.532256 20961 tablet_replica.cc:439] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "78acbff041394e8db7ffccda3ae26004" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } }
I20260812 00:20:38.532289 20962 tablet_replica.cc:439] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "78acbff041394e8db7ffccda3ae26004" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 } } peers { permanent_uuid: "e1e8a65f13b14fff85554fdf2439b2fd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45015 } } peers { permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 } } }
I20260812 00:20:38.532579 20962 tablet_replica.cc:442] T bec858bdc607423bad0f7a523fd8c044 P e1e8a65f13b14fff85554fdf2439b2fd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:20:38.532600 20961 tablet_replica.cc:442] T bec858bdc607423bad0f7a523fd8c044 P 8efe2ab4f75c465d808352336ada3e6e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:20:38.546846 20949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.540476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:42133 (local address 127.18.163.193:36881)
0812 00:20:38.540962 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:38.540969 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:38.541421 (+ 452us) server_negotiation.cc:407] Connection header received
0812 00:20:38.541718 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:38.541724 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:38.541807 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:38.541915 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:20:38.542464 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.543237 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.544674 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.545226 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.545397 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.545970 (+ 573us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:20:38.546100 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:20:38.546209 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:38.546374 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 00:20:38.546465 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295}
I20260812 00:20:38.546917 21023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.540478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:36881 (local address 127.18.163.194:42133)
0812 00:20:38.541297 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:38.541315 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:38.541521 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:38.541938 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:38.541943 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:38.541956 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:20:38.542269 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:38.542279 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.543396 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.543401 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:38.544500 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:38.544514 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.545436 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.545443 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:38.545687 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.545759 (+ 72us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:20:38.546215 (+ 456us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:20:38.546229 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 00:20:38.546332 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 00:20:38.546492 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":496,"threads_started":1}
I20260812 00:20:38.560359 20877 raft_consensus.cc:1261] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [term 1 FOLLOWER]: Refusing update from remote peer e1e8a65f13b14fff85554fdf2439b2fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:20:38.561185 20977 consensus_queue.cc:1035] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8efe2ab4f75c465d808352336ada3e6e" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:20:38.568899 20559 raft_consensus.cc:1261] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004 [term 1 FOLLOWER]: Refusing update from remote peer e1e8a65f13b14fff85554fdf2439b2fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:20:38.570492 20962 consensus_queue.cc:1035] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "78acbff041394e8db7ffccda3ae26004" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 36881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:20:38.613095 20953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.604980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:52327 (local address 127.18.163.194:45015)
0812 00:20:38.605214 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:38.605223 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:38.606074 (+ 851us) server_negotiation.cc:407] Connection header received
0812 00:20:38.606372 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:38.606379 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:38.606474 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:38.606572 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:20:38.607476 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.608637 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.610875 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.611407 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.611565 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.612189 (+ 624us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:20:38.612316 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:20:38.612429 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:38.612653 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 00:20:38.612743 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 00:20:38.613308 21030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.605047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:45015 (local address 127.18.163.193:52327)
0812 00:20:38.605962 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:38.605979 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:38.606172 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:38.606745 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:38.606750 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:38.606764 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:20:38.607238 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:38.607253 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.608774 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.608780 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:38.610692 (+ 1912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:38.610711 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.611645 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.611653 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:38.611821 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.611920 (+ 99us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:20:38.612487 (+ 567us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:20:38.612501 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 00:20:38.612622 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 00:20:38.612784 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"thread_start_us":451,"threads_started":1}
I20260812 00:20:38.663492 20373 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:20:38.663821 20373 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:20:38.667807 20373 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 787776b6dde346e6b459248e1864c8cb: Sending DeleteTablet for 3 replicas of tablet 92b2d53a07f044d380937939caee4c90
I20260812 00:20:38.669106 20690 tablet_service.cc:1514] Processing DeleteTablet for tablet 92b2d53a07f044d380937939caee4c90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:38 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:45226
I20260812 00:20:38.669104 20849 tablet_service.cc:1514] Processing DeleteTablet for tablet 92b2d53a07f044d380937939caee4c90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:38 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:35344
I20260812 00:20:38.669840 20533 tablet_service.cc:1514] Processing DeleteTablet for tablet 92b2d53a07f044d380937939caee4c90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:38 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:47916
I20260812 00:20:38.685271 21034 tablet_replica.cc:330] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004: stopping tablet replica
I20260812 00:20:38.685607 21034 raft_consensus.cc:2229] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:20:38.686121 21034 raft_consensus.cc:2258] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:20:38.688417 21034 ts_tablet_manager.cc:1905] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:20:38.689251 21032 tablet_replica.cc:330] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e: stopping tablet replica
I20260812 00:20:38.689533 21032 raft_consensus.cc:2229] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:20:38.689955 21032 raft_consensus.cc:2258] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:20:38.691555 21032 ts_tablet_manager.cc:1905] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 00:20:38 dist-test-slave-njxd krb5kdc[20316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494037, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:20:38.707388 21033 tablet_replica.cc:330] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd: stopping tablet replica
I20260812 00:20:38.707651 21033 raft_consensus.cc:2229] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:20:38.708173 21033 raft_consensus.cc:2258] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:20:38.709822 20949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.685095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47922 (local address 127.18.163.193:36881)
0812 00:20:38.685314 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:38.685322 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:38.687295 (+ 1973us) server_negotiation.cc:407] Connection header received
0812 00:20:38.687616 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:38.687623 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:38.687727 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:38.687806 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:38.690632 (+ 2826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.691857 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.694015 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.694740 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.694842 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.700641 (+ 5799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:38.700661 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:38.700681 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:38.700731 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:38.705379 (+ 4648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:38.706444 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:38.706454 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:38.706458 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:38.706631 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:38.707127 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:38.707133 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:38.707136 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:38.707629 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:38.707942 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:38.709010 (+ 1068us) server_negotiation.cc:299] Negotiation successful
0812 00:20:38.709365 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 00:20:38.710088 21033 ts_tablet_manager.cc:1905] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 00:20:38.711202 20607 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47922
I20260812 00:20:38.713156 21034 ts_tablet_manager.cc:1918] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:20:38.713323 21034 log.cc:1196] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/92b2d53a07f044d380937939caee4c90
I20260812 00:20:38.713842 21034 ts_tablet_manager.cc:1939] T 92b2d53a07f044d380937939caee4c90 P 78acbff041394e8db7ffccda3ae26004: Deleting consensus metadata
I20260812 00:20:38.715109 20354 catalog_manager.cc:4841] TS 78acbff041394e8db7ffccda3ae26004 (127.18.163.193:36881): tablet 92b2d53a07f044d380937939caee4c90 (table test-table [id=32510001074f4e81939eebafdee2e37b]) successfully deleted
I20260812 00:20:38.719534 21032 ts_tablet_manager.cc:1918] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:20:38.719712 21032 log.cc:1196] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/92b2d53a07f044d380937939caee4c90
I20260812 00:20:38.720196 21032 ts_tablet_manager.cc:1939] T 92b2d53a07f044d380937939caee4c90 P 8efe2ab4f75c465d808352336ada3e6e: Deleting consensus metadata
I20260812 00:20:38.720533 21033 ts_tablet_manager.cc:1918] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:20:38.720745 21033 log.cc:1196] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/92b2d53a07f044d380937939caee4c90
I20260812 00:20:38.721273 21033 ts_tablet_manager.cc:1939] T 92b2d53a07f044d380937939caee4c90 P e1e8a65f13b14fff85554fdf2439b2fd: Deleting consensus metadata
I20260812 00:20:38.721546 20359 catalog_manager.cc:4841] TS 8efe2ab4f75c465d808352336ada3e6e (127.18.163.195:40085): tablet 92b2d53a07f044d380937939caee4c90 (table test-table [id=32510001074f4e81939eebafdee2e37b]) successfully deleted
I20260812 00:20:38.722573 20354 catalog_manager.cc:4841] TS e1e8a65f13b14fff85554fdf2439b2fd (127.18.163.194:45015): tablet 92b2d53a07f044d380937939caee4c90 (table test-table [id=32510001074f4e81939eebafdee2e37b]) successfully deleted
I20260812 00:20:38.733671 21000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.714798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47442 (local address 127.18.163.254:43257)
0812 00:20:38.715082 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:38.715093 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:38.718152 (+ 3059us) server_negotiation.cc:407] Connection header received
0812 00:20:38.718454 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:38.718460 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:38.718551 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:38.718633 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:38.720649 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.721905 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.723529 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.724210 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.724356 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.727176 (+ 2820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:38.727184 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:38.727189 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:38.727236 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:38.730673 (+ 3437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:38.731468 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:38.731475 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:38.731479 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:38.731647 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:38.732038 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:38.732045 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:38.732049 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:38.732470 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:38.732734 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:38.733045 (+ 311us) server_negotiation.cc:299] Negotiation successful
0812 00:20:38.733311 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
W20260812 00:20:38.734400 20373 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47442
I20260812 00:20:38.736974 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 20458
I20260812 00:20:38.751755 20949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.738411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47926 (local address 127.18.163.193:36881)
0812 00:20:38.738603 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:38.738610 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:38.739011 (+ 401us) server_negotiation.cc:407] Connection header received
0812 00:20:38.739239 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:38.739246 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:38.739319 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:38.739448 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:38.740622 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.741447 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.742691 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.743218 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.743374 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.745837 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:38.745843 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:38.745846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:38.745884 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:38.748868 (+ 2984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:38.749629 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:38.749635 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:38.749638 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:38.749783 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:38.750185 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:38.750191 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:38.750195 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:38.750494 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:38.750814 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:38.751102 (+ 288us) server_negotiation.cc:299] Negotiation successful
0812 00:20:38.751380 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260812 00:20:38.752400 20607 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47926
W20260812 00:20:38.753067 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 20458: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:20:38.753273 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 20458
I20260812 00:20:38.780509 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 20616
Aug 12 00:20:38 dist-test-slave-njxd krb5kdc[20316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494037, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
I20260812 00:20:38.798496 20953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.781373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45234 (local address 127.18.163.194:45015)
0812 00:20:38.781624 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:38.781632 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:38.781656 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:20:38.781742 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:38.781746 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:38.781820 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:38.781898 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:38.783295 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.784329 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.786391 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.787044 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.787150 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.792027 (+ 4877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:38.792046 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:38.792063 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:38.792114 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:38.795532 (+ 3418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:38.796342 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:38.796350 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:38.796353 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:38.796520 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:38.796883 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:38.796887 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:38.796889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:38.797257 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:38.797506 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:38.797900 (+ 394us) server_negotiation.cc:299] Negotiation successful
0812 00:20:38.798111 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260812 00:20:38.799306 20766 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45234
W20260812 00:20:38.800073 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 20616: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:20:38.800299 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 20616
I20260812 00:20:38.830412 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 20775
Aug 12 00:20:38 dist-test-slave-njxd krb5kdc[20316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494037, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:20:38.846603 21006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:38.831273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35360 (local address 127.18.163.195:40085)
0812 00:20:38.831481 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:38.831489 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:38.831512 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:20:38.831742 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:38.831748 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:38.831841 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:38.831952 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:38.833311 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.834117 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.835413 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:38.835856 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:38.836002 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:38.840579 (+ 4577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:38.840597 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:38.840615 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:38.840658 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:38.843514 (+ 2856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:38.844239 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:38.844256 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:38.844264 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:38.844419 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:38.844828 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:38.844835 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:38.844838 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:38.845236 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:38.845564 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:38.846046 (+ 482us) server_negotiation.cc:299] Negotiation successful
0812 00:20:38.846314 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260812 00:20:38.847347 20929 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35360
W20260812 00:20:38.848069 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 20775: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:20:38.848270 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 20775
I20260812 00:20:38.872007 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 20336
I20260812 00:20:38.873265 20419 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:20:38.996129 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 20336
2026-08-12T00:20:39Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5240 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:20:39 dist-test-slave-njxd krb5kdc[21045](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:20:39 dist-test-slave-njxd krb5kdc[21045](info): set up 2 sockets
Aug 12 00:20:39 dist-test-slave-njxd krb5kdc[21045](info): commencing operation
krb5kdc: starting...
W20260812 00:20:40.202291 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.003s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:20:40 dist-test-slave-njxd krb5kdc[21045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:20:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:20:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:20:40.453074 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44799
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:41223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:44799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:40.817253 21059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:40.817693 21059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:40.817873 21059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:40.825508 21059 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:20:40.825670 21059 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 00:20:40.825726 21059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:40.825845 21059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:40.825942 21059 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:20:40.826054 21059 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:20:40.836701 21059 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:41223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:44799
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:40.838295 21059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:40.839839 21059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:40.852653 21065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:40.852666 21064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:40.852716 21068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:40.853966 21059 server_base.cc:1034] running on GCE node
I20260812 00:20:40.854893 21059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:40.856460 21059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:40.857719 21059 hybrid_clock.cc:648] HybridClock initialized: now 1786494040857636 us; error 38 us; skew 500 ppm
I20260812 00:20:40.858104 21059 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:40 dist-test-slave-njxd krb5kdc[21045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494040, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:40.861472 21059 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:20:40.863243 21059 webserver.cc:460] Webserver started at http://127.18.163.254:38157/ using document root <none> and password file <none>
I20260812 00:20:40.864059 21059 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:40.864208 21059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:40.864565 21059 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:40.867976 21059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "298d56b47d954672b72d38ccbb04fdee"
format_stamp: "Formatted at 2026-08-12 00:20:40 on dist-test-slave-njxd"
server_key: "2983a78f66e565658052a7d045e35685"
server_key_iv: "771c29c491874681705d41a7ac4b891c"
server_key_version: "encryptionkey@0"
I20260812 00:20:40.868873 21059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "298d56b47d954672b72d38ccbb04fdee"
format_stamp: "Formatted at 2026-08-12 00:20:40 on dist-test-slave-njxd"
server_key: "2983a78f66e565658052a7d045e35685"
server_key_iv: "771c29c491874681705d41a7ac4b891c"
server_key_version: "encryptionkey@0"
I20260812 00:20:40.875064 21059 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 00:20:40.879176 21076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:40.880666 21059 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260812 00:20:40.880887 21059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "298d56b47d954672b72d38ccbb04fdee"
format_stamp: "Formatted at 2026-08-12 00:20:40 on dist-test-slave-njxd"
server_key: "2983a78f66e565658052a7d045e35685"
server_key_iv: "771c29c491874681705d41a7ac4b891c"
server_key_version: "encryptionkey@0"
I20260812 00:20:40.881142 21059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:40.892966 21059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:40.897318 21059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:40.897670 21059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:40.921145 21059 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:44799
I20260812 00:20:40.921168 21146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:44799 every 8 connection(s)
I20260812 00:20:40.922741 21059 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:20:40.926678 21147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:40.930146 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 21059
I20260812 00:20:40.930380 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:20:40.931206 19087 external_mini_cluster.cc:1428] Setting key 03a98da54ccf4f4faa788dfa6fc97caf
I20260812 00:20:40.940346 21147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee: Bootstrap starting.
I20260812 00:20:40.944562 21147 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:40.946106 21147 log.cc:824] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee: Log is configured to *not* fsync() on all Append() calls
Aug 12 00:20:40 dist-test-slave-njxd krb5kdc[21045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:40.949714 21147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee: No bootstrap required, opened a new log
I20260812 00:20:40.956161 21150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:40.933442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35460 (local address 127.18.163.254:44799)
0812 00:20:40.934275 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:40.934287 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:40.934331 (+ 44us) server_negotiation.cc:407] Connection header received
0812 00:20:40.936047 (+ 1716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:40.936070 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:40.936499 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:40.936862 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:40.938740 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:40.940035 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:40.941880 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:40.942569 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:40.942739 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:40.948056 (+ 5317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:40.948064 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:40.948081 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:40.948155 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:40.951393 (+ 3238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:40.952237 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:40.952245 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:40.952252 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:40.952458 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:40.952914 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:40.952919 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:40.952923 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:40.953531 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:40.953928 (+ 397us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:40.954456 (+ 528us) server_negotiation.cc:299] Negotiation successful
0812 00:20:40.954975 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":421,"threads_started":1}
I20260812 00:20:40.958276 21147 raft_consensus.cc:348] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "298d56b47d954672b72d38ccbb04fdee" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44799 } }
I20260812 00:20:40.958675 21147 raft_consensus.cc:374] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:40.958809 21147 raft_consensus.cc:729] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 298d56b47d954672b72d38ccbb04fdee, State: Initialized, Role: FOLLOWER
I20260812 00:20:40.959556 21147 consensus_queue.cc:260] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "298d56b47d954672b72d38ccbb04fdee" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44799 } }
I20260812 00:20:40.959849 21147 raft_consensus.cc:388] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:20:40.959986 21147 raft_consensus.cc:482] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:20:40.960165 21147 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:40.962571 21147 raft_consensus.cc:504] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "298d56b47d954672b72d38ccbb04fdee" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44799 } }
I20260812 00:20:40.963161 21147 leader_election.cc:302] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 298d56b47d954672b72d38ccbb04fdee; no voters:
I20260812 00:20:40.963905 21147 leader_election.cc:288] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:20:40.964066 21152 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:20:40.964896 21152 raft_consensus.cc:686] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [term 1 LEADER]: Becoming Leader. State: Replica: 298d56b47d954672b72d38ccbb04fdee, State: Running, Role: LEADER
I20260812 00:20:40.965436 21152 consensus_queue.cc:237] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "298d56b47d954672b72d38ccbb04fdee" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44799 } }
I20260812 00:20:40.966416 21147 sys_catalog.cc:564] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:20:40.968536 21154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 298d56b47d954672b72d38ccbb04fdee. Latest consensus state: current_term: 1 leader_uuid: "298d56b47d954672b72d38ccbb04fdee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "298d56b47d954672b72d38ccbb04fdee" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44799 } } }
I20260812 00:20:40.969069 21154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [sys.catalog]: This master's current role is: LEADER
I20260812 00:20:40.970283 21153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "298d56b47d954672b72d38ccbb04fdee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "298d56b47d954672b72d38ccbb04fdee" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44799 } } }
I20260812 00:20:40.970738 21153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee [sys.catalog]: This master's current role is: LEADER
I20260812 00:20:40.972020 21161 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:20:40.977784 21161 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:20:40.988979 21161 catalog_manager.cc:1347] Generated new cluster ID: 8383e54d23814209a4ae5d88d4745b23
I20260812 00:20:40.989128 21161 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:20:40.997866 21161 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:20:40.999267 21161 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:20:41.005199 21161 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee: Generated new TSK 0
I20260812 00:20:41.006364 21161 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:20:41.069408 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44799
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:41223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:41.435168 21176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:41.435490 21176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:41.435599 21176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:41.443276 21176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:41.443435 21176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:41.443531 21176 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 00:20:41.443588 21176 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:20:41.443653 21176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:20:41.454437 21176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:41223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.163.254:44799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:41.455914 21176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:41.457810 21176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:41.473358 21182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:41.473441 21183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:41.473452 21185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:41.479230 21176 server_base.cc:1034] running on GCE node
I20260812 00:20:41.480018 21176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:41.481130 21176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:41.482375 21176 hybrid_clock.cc:648] HybridClock initialized: now 1786494041482285 us; error 97 us; skew 500 ppm
I20260812 00:20:41.482729 21176 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:41 dist-test-slave-njxd krb5kdc[21045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494041, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:41.491189 21176 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:20:41.493077 21176 webserver.cc:460] Webserver started at http://127.18.163.193:36395/ using document root <none> and password file <none>
I20260812 00:20:41.494024 21176 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:41.494199 21176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:41.494572 21176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:41.498111 21176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "ca390bb32ace462b8eb99dda189f06eb"
format_stamp: "Formatted at 2026-08-12 00:20:41 on dist-test-slave-njxd"
server_key: "1be1981cd95ffc13f32c4ac0eb13f0c3"
server_key_iv: "df29dfc6738152eae38124b068d636ff"
server_key_version: "encryptionkey@0"
I20260812 00:20:41.499212 21176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "ca390bb32ace462b8eb99dda189f06eb"
format_stamp: "Formatted at 2026-08-12 00:20:41 on dist-test-slave-njxd"
server_key: "1be1981cd95ffc13f32c4ac0eb13f0c3"
server_key_iv: "df29dfc6738152eae38124b068d636ff"
server_key_version: "encryptionkey@0"
I20260812 00:20:41.505257 21176 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260812 00:20:41.509280 21195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:41.510838 21176 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:20:41.511045 21176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "ca390bb32ace462b8eb99dda189f06eb"
format_stamp: "Formatted at 2026-08-12 00:20:41 on dist-test-slave-njxd"
server_key: "1be1981cd95ffc13f32c4ac0eb13f0c3"
server_key_iv: "df29dfc6738152eae38124b068d636ff"
server_key_version: "encryptionkey@0"
I20260812 00:20:41.511283 21176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:41.539378 21176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:41.544456 21176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:41.544806 21176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:41.547958 21176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:41.548157 21176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:41.548309 21176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:41.548427 21176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:20:41 dist-test-slave-njxd krb5kdc[21045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494041, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:41.575047 21205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:41.548691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:38995 (local address 127.18.163.254:44799)
0812 00:20:41.549453 (+ 762us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:41.549460 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:41.550817 (+ 1357us) server_negotiation.cc:407] Connection header received
0812 00:20:41.553259 (+ 2442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:41.553268 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:41.553392 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:41.553545 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:41.556380 (+ 2835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:41.557538 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:41.560305 (+ 2767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:41.560982 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:41.561146 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:41.567395 (+ 6249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:41.567401 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:41.567404 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:41.567445 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:41.571291 (+ 3846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:41.572226 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:41.572232 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:41.572238 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:41.572380 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:41.572905 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:41.572917 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:41.572919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:41.573210 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:41.573378 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:41.574517 (+ 1139us) server_negotiation.cc:299] Negotiation successful
0812 00:20:41.574737 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":483,"threads_started":1}
I20260812 00:20:41.577042 21206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:41.549496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44799 (local address 127.18.163.193:38995)
0812 00:20:41.550589 (+ 1093us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:41.550640 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:41.552821 (+ 2181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:41.553892 (+ 1071us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:41.553902 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:41.554842 (+ 940us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:41.556066 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:41.556100 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:41.557837 (+ 1737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:41.557846 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:41.560109 (+ 2263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:41.560132 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:41.561273 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:41.561282 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:41.561530 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:41.562494 (+ 964us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:41.562538 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:41.566961 (+ 4423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:41.571484 (+ 4523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:41.571496 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:41.571517 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:41.572059 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:41.572512 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:41.572518 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:41.572521 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:41.572767 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:41.573359 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:41.573368 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:41.573910 (+ 542us) client_negotiation.cc:769] Sending connection context
0812 00:20:41.575366 (+ 1456us) client_negotiation.cc:240] Negotiation successful
0812 00:20:41.575864 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":781,"thread_start_us":453,"threads_started":1}
I20260812 00:20:41.602125 21205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:41.584984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:52961 (local address 127.18.163.254:44799)
0812 00:20:41.585248 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:41.585255 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:41.586407 (+ 1152us) server_negotiation.cc:407] Connection header received
0812 00:20:41.586571 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:41.586580 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:41.586704 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:41.586854 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:41.587948 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:41.589442 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:41.591773 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:41.592244 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:41.592404 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:41.595601 (+ 3197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:41.595609 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:41.595615 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:41.595665 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:41.598903 (+ 3238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:41.599944 (+ 1041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:41.599949 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:41.599953 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:41.600112 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:41.600522 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:41.600529 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:41.600536 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:41.600842 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:41.601034 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:41.601458 (+ 424us) server_negotiation.cc:299] Negotiation successful
0812 00:20:41.601745 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 00:20:41.602344 21284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:41.584998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44799 (local address 127.18.163.193:52961)
0812 00:20:41.586279 (+ 1281us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:41.586298 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:41.586447 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:41.586895 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:41.586899 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:41.587428 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:41.587773 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:41.587784 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:41.589735 (+ 1951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:41.589744 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:41.591578 (+ 1834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:41.591595 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:41.592461 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:41.592468 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:41.592714 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:41.593615 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:41.593655 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:41.595319 (+ 1664us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:41.599073 (+ 3754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:41.599081 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:41.599090 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:41.599789 (+ 699us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:41.600244 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:41.600252 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:41.600255 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:41.600393 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:41.600971 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:41.600977 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:41.601186 (+ 209us) client_negotiation.cc:769] Sending connection context
0812 00:20:41.601333 (+ 147us) client_negotiation.cc:240] Negotiation successful
0812 00:20:41.601781 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1097,"thread_start_us":848,"threads_started":1}
I20260812 00:20:41.611460 21176 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:39499
I20260812 00:20:41.611501 21334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:39499 every 8 connection(s)
I20260812 00:20:41.612845 21176 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:20:41.615329 21335 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44799
I20260812 00:20:41.615551 21335 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:41.616308 21335 heartbeater.cc:511] Master 127.18.163.254:44799 requested a full tablet report, sending...
I20260812 00:20:41.618432 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 21176
I20260812 00:20:41.618515 21096 ts_manager.cc:194] Registered new tserver with Master: ca390bb32ace462b8eb99dda189f06eb (127.18.163.193:39499)
I20260812 00:20:41.618676 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:20:41.619333 19087 external_mini_cluster.cc:1428] Setting key 31cbb236f375d639d90660eac139dae9
I20260812 00:20:41.620292 21096 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:38995
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:20:41.672748 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44799
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:41223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:42.030773 21339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:42.031106 21339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:42.031216 21339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:42.038794 21339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:42.038929 21339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:42.039028 21339 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 00:20:42.039091 21339 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:20:42.039165 21339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:20:42.049547 21339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:41223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.163.254:44799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:42.050966 21339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:42.052357 21339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:42.066500 21344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:42.066461 21347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:42.066526 21345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:42.067602 21339 server_base.cc:1034] running on GCE node
I20260812 00:20:42.068364 21339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:42.069550 21339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:42.070856 21339 hybrid_clock.cc:648] HybridClock initialized: now 1786494042070806 us; error 48 us; skew 500 ppm
I20260812 00:20:42.071225 21339 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:42 dist-test-slave-njxd krb5kdc[21045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494042, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:42.074692 21339 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:20:42.076464 21339 webserver.cc:460] Webserver started at http://127.18.163.194:37853/ using document root <none> and password file <none>
I20260812 00:20:42.077244 21339 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:42.077410 21339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:42.077833 21339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:42.081139 21339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "81d0f7307a83413283fd4359523be6c7"
format_stamp: "Formatted at 2026-08-12 00:20:42 on dist-test-slave-njxd"
server_key: "e133984fb668e63aa5f8cfd07c65e954"
server_key_iv: "3bbdab5c89bcd0fb23cb7c6d6a2a32be"
server_key_version: "encryptionkey@0"
I20260812 00:20:42.082029 21339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "81d0f7307a83413283fd4359523be6c7"
format_stamp: "Formatted at 2026-08-12 00:20:42 on dist-test-slave-njxd"
server_key: "e133984fb668e63aa5f8cfd07c65e954"
server_key_iv: "3bbdab5c89bcd0fb23cb7c6d6a2a32be"
server_key_version: "encryptionkey@0"
I20260812 00:20:42.087738 21339 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260812 00:20:42.091682 21354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:42.093134 21339 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:20:42.093329 21339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "81d0f7307a83413283fd4359523be6c7"
format_stamp: "Formatted at 2026-08-12 00:20:42 on dist-test-slave-njxd"
server_key: "e133984fb668e63aa5f8cfd07c65e954"
server_key_iv: "3bbdab5c89bcd0fb23cb7c6d6a2a32be"
server_key_version: "encryptionkey@0"
I20260812 00:20:42.093606 21339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:42.129796 21339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:42.135159 21339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:42.135505 21339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:42.138805 21339 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:42.138944 21339 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:42.139086 21339 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:42.139186 21339 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:20:42 dist-test-slave-njxd krb5kdc[21045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494042, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:42.163853 21364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.139360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:44733 (local address 127.18.163.254:44799)
0812 00:20:42.140217 (+ 857us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:42.140222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:42.141211 (+ 989us) server_negotiation.cc:407] Connection header received
0812 00:20:42.143603 (+ 2392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:42.143611 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:42.143718 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:42.143852 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:42.146458 (+ 2606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.147544 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.149680 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.150281 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.150429 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.155987 (+ 5558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:42.155992 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:42.155996 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:42.156034 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:42.159729 (+ 3695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:42.160862 (+ 1133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:42.160874 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:42.160878 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:42.161046 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:42.161817 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:42.161822 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:42.161826 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:42.162151 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:42.162342 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:42.163174 (+ 832us) server_negotiation.cc:299] Negotiation successful
0812 00:20:42.163443 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":742,"thread_start_us":611,"threads_started":1}
I20260812 00:20:42.165220 21365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.140146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44799 (local address 127.18.163.194:44733)
0812 00:20:42.141016 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:42.141073 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:42.143263 (+ 2190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:42.144188 (+ 925us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:42.144204 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:42.145178 (+ 974us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:42.146171 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.146206 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.147737 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.147741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.149468 (+ 1727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.149483 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.150662 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.150673 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.151120 (+ 447us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.152033 (+ 913us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:42.152063 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:42.155651 (+ 3588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:42.159949 (+ 4298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:42.159958 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:42.159974 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:42.160709 (+ 735us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:42.161232 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:42.161241 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:42.161245 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:42.161670 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:42.162301 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:42.162310 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:42.162748 (+ 438us) client_negotiation.cc:769] Sending connection context
0812 00:20:42.163037 (+ 289us) client_negotiation.cc:240] Negotiation successful
0812 00:20:42.163674 (+ 637us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":368,"threads_started":1}
I20260812 00:20:42.188807 21364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.172054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:53419 (local address 127.18.163.254:44799)
0812 00:20:42.172229 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:42.172233 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:42.173311 (+ 1078us) server_negotiation.cc:407] Connection header received
0812 00:20:42.173530 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:42.173537 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:42.173705 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:42.173823 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:42.175446 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.176375 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.178609 (+ 2234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.179165 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.179320 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.181366 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:42.181371 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:42.181375 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:42.181408 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:42.185104 (+ 3696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:42.186322 (+ 1218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:42.186326 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:42.186328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:42.186505 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:42.187044 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:42.187051 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:42.187056 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:42.187553 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:42.187740 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:42.188178 (+ 438us) server_negotiation.cc:299] Negotiation successful
0812 00:20:42.188435 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 00:20:42.188911 21427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.172180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44799 (local address 127.18.163.194:53419)
0812 00:20:42.173196 (+ 1016us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:42.173218 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:42.173390 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:42.173887 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:42.173895 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:42.174732 (+ 837us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:42.175261 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.175280 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.176596 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.176605 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.178426 (+ 1821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.178442 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.179388 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.179397 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.179593 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.180263 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:42.180281 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:42.181143 (+ 862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:42.185312 (+ 4169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:42.185320 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:42.185326 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:42.186106 (+ 780us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:42.186689 (+ 583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:42.186694 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:42.186698 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:42.186878 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:42.187696 (+ 818us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:42.187701 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:42.187917 (+ 216us) client_negotiation.cc:769] Sending connection context
0812 00:20:42.188079 (+ 162us) client_negotiation.cc:240] Negotiation successful
0812 00:20:42.188453 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":873,"thread_start_us":573,"threads_started":1}
I20260812 00:20:42.204937 21339 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:35691
I20260812 00:20:42.204967 21487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:35691 every 8 connection(s)
I20260812 00:20:42.206483 21339 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:20:42.208973 21489 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44799
I20260812 00:20:42.209206 21489 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:42.209950 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 21339
I20260812 00:20:42.209980 21489 heartbeater.cc:511] Master 127.18.163.254:44799 requested a full tablet report, sending...
I20260812 00:20:42.210143 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:20:42.210613 19087 external_mini_cluster.cc:1428] Setting key cb19b2659c42cc108fd2e5fa564fc37e
I20260812 00:20:42.211719 21095 ts_manager.cc:194] Registered new tserver with Master: 81d0f7307a83413283fd4359523be6c7 (127.18.163.194:35691)
I20260812 00:20:42.212988 21095 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:44733
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
I20260812 00:20:42.264740 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44799
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:41223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:20:42.624329 21335 heartbeater.cc:503] Master 127.18.163.254:44799 was elected leader, sending a full tablet report...
W20260812 00:20:42.631908 21493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:42.632292 21493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:42.632488 21493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:42.640475 21493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:42.640640 21493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:42.640769 21493 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 00:20:42.640832 21493 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:20:42.640929 21493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:20:42.652434 21493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:41223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.163.254:44799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:42.654143 21493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:42.655682 21493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:42.670933 21498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:42.671012 21499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:42.671237 21502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:42.672155 21493 server_base.cc:1034] running on GCE node
I20260812 00:20:42.672835 21493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:42.673975 21493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:42.675201 21493 hybrid_clock.cc:648] HybridClock initialized: now 1786494042675153 us; error 42 us; skew 500 ppm
I20260812 00:20:42.675541 21493 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:42 dist-test-slave-njxd krb5kdc[21045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494042, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:42.679261 21493 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:20:42.681313 21493 webserver.cc:460] Webserver started at http://127.18.163.195:44227/ using document root <none> and password file <none>
I20260812 00:20:42.682184 21493 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:42.682340 21493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:42.682698 21493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:42.686267 21493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4"
format_stamp: "Formatted at 2026-08-12 00:20:42 on dist-test-slave-njxd"
server_key: "367b57b9a4c5bf14b83b51dea111ec40"
server_key_iv: "98b12069243bf45aa5c0919b2409f665"
server_key_version: "encryptionkey@0"
I20260812 00:20:42.687183 21493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4"
format_stamp: "Formatted at 2026-08-12 00:20:42 on dist-test-slave-njxd"
server_key: "367b57b9a4c5bf14b83b51dea111ec40"
server_key_iv: "98b12069243bf45aa5c0919b2409f665"
server_key_version: "encryptionkey@0"
I20260812 00:20:42.693313 21493 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260812 00:20:42.697494 21509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:42.699222 21493 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:20:42.699426 21493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4"
format_stamp: "Formatted at 2026-08-12 00:20:42 on dist-test-slave-njxd"
server_key: "367b57b9a4c5bf14b83b51dea111ec40"
server_key_iv: "98b12069243bf45aa5c0919b2409f665"
server_key_version: "encryptionkey@0"
I20260812 00:20:42.699658 21493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:42.718015 21493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:42.723006 21493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:42.723351 21493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:42.726496 21493 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:42.726604 21493 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:42.726799 21493 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:42.726908 21493 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:20:42 dist-test-slave-njxd krb5kdc[21045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494042, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:42.753840 21520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.727035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:42915 (local address 127.18.163.254:44799)
0812 00:20:42.727929 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:42.727936 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:42.729092 (+ 1156us) server_negotiation.cc:407] Connection header received
0812 00:20:42.731486 (+ 2394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:42.731497 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:42.731617 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:42.731746 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:42.734279 (+ 2533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.735440 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.738239 (+ 2799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.738856 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.739014 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.744836 (+ 5822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:42.744847 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:42.744853 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:42.744905 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:42.749354 (+ 4449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:42.750582 (+ 1228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:42.750592 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:42.750598 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:42.750799 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:42.751314 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:42.751323 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:42.751329 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:42.751792 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:42.751995 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:42.752831 (+ 836us) server_negotiation.cc:299] Negotiation successful
0812 00:20:42.753195 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":762,"thread_start_us":633,"threads_started":1}
I20260812 00:20:42.754621 21521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.727877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44799 (local address 127.18.163.195:42915)
0812 00:20:42.728878 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:42.728931 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:42.731119 (+ 2188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:42.732052 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:42.732072 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:42.732883 (+ 811us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:42.734025 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.734064 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.735670 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.735677 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.738052 (+ 2375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.738073 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.739145 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.739154 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.739426 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.740239 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:42.740284 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:42.744366 (+ 4082us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:42.749649 (+ 5283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:42.749665 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:42.749694 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:42.750416 (+ 722us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:42.750927 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:42.750931 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:42.750934 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:42.751166 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:42.751944 (+ 778us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:42.751958 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:42.752367 (+ 409us) client_negotiation.cc:769] Sending connection context
0812 00:20:42.752627 (+ 260us) client_negotiation.cc:240] Negotiation successful
0812 00:20:42.753079 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"thread_start_us":458,"threads_started":1}
I20260812 00:20:42.780928 21600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.762707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44799 (local address 127.18.163.195:51093)
0812 00:20:42.763739 (+ 1032us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:42.763764 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:42.763985 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:42.764464 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:42.764473 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:42.765304 (+ 831us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:42.765898 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.765917 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.767447 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.767455 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.769366 (+ 1911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.769394 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.770391 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.770397 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.770606 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.771381 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:42.771399 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:42.772728 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:42.777083 (+ 4355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:42.777089 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:42.777093 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:42.777799 (+ 706us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:42.778404 (+ 605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:42.778410 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:42.778413 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:42.778604 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:42.779217 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:42.779226 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:42.779510 (+ 284us) client_negotiation.cc:769] Sending connection context
0812 00:20:42.779720 (+ 210us) client_negotiation.cc:240] Negotiation successful
0812 00:20:42.780210 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":815,"thread_start_us":448,"threads_started":1}
I20260812 00:20:42.781073 21520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.762705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:51093 (local address 127.18.163.254:44799)
0812 00:20:42.762923 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:42.762932 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:42.763877 (+ 945us) server_negotiation.cc:407] Connection header received
0812 00:20:42.764171 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:42.764180 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:42.764282 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:42.764375 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:42.766183 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.767201 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.769543 (+ 2342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.770167 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.770337 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.772967 (+ 2630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:42.772972 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:42.772976 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:42.773038 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:42.776913 (+ 3875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:42.778030 (+ 1117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:42.778038 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:42.778042 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:42.778241 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:42.778739 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:42.778742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:42.778744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:42.779048 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:42.779256 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:42.780610 (+ 1354us) server_negotiation.cc:299] Negotiation successful
0812 00:20:42.780810 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 00:20:42.781880 21493 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:45815
I20260812 00:20:42.781921 21644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:45815 every 8 connection(s)
I20260812 00:20:42.783651 21493 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:20:42.786459 21645 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44799
I20260812 00:20:42.786798 21645 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:42.787904 21645 heartbeater.cc:511] Master 127.18.163.254:44799 requested a full tablet report, sending...
I20260812 00:20:42.789975 21095 ts_manager.cc:194] Registered new tserver with Master: e6b1855cbdb0499c92ba2f3e758ba2a4 (127.18.163.195:45815)
I20260812 00:20:42.790922 21095 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:42915
I20260812 00:20:42.792555 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 21493
I20260812 00:20:42.792760 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:20:42.793222 19087 external_mini_cluster.cc:1428] Setting key 1c517d938eef953e92117bf48b3bc66a
I20260812 00:20:42.796305 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:20:42 dist-test-slave-njxd krb5kdc[21045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:20:42 dist-test-slave-njxd krb5kdc[21045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:42.855749 21520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.841621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33258 (local address 127.18.163.254:44799)
0812 00:20:42.841880 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:42.841887 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:42.842135 (+ 248us) server_negotiation.cc:407] Connection header received
0812 00:20:42.842314 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:42.842318 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:42.842389 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:42.842478 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:42.844047 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.844794 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.846099 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.846528 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.846630 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.850736 (+ 4106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:42.850742 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:42.850745 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:42.850787 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:42.853360 (+ 2573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:42.854104 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:42.854108 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:42.854110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:42.854245 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:42.854588 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:42.854591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:42.854593 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:42.854869 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:42.855071 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:42.855307 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 00:20:42.855486 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 00:20:42.860172 21095 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33258:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:20:42.867735 21095 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:20:42.906168 21663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.882579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43406 (local address 127.18.163.195:45815)
0812 00:20:42.896373 (+ 13794us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:42.896384 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:42.896424 (+ 40us) server_negotiation.cc:407] Connection header received
0812 00:20:42.896532 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:42.896540 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:42.896803 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:42.897084 (+ 281us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:42.899069 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.900744 (+ 1675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.902971 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.904600 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.904879 (+ 279us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.905087 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:42.905567 (+ 480us) server_negotiation.cc:299] Negotiation successful
0812 00:20:42.905796 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13591,"thread_start_us":14312,"threads_started":1}
I20260812 00:20:42.906250 21661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.882178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:45815 (local address 127.0.0.1:43406)
0812 00:20:42.896162 (+ 13984us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:42.896191 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:42.896362 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:42.897104 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:42.897114 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:42.897181 (+ 67us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:42.898592 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.898608 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.900888 (+ 2280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.900896 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.902769 (+ 1873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.902785 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.904867 (+ 2082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.904874 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.905242 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.905308 (+ 66us) client_negotiation.cc:769] Sending connection context
0812 00:20:42.905460 (+ 152us) client_negotiation.cc:240] Negotiation successful
0812 00:20:42.905722 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13775,"mutex_wait_us":47,"spinlock_wait_cycles":23040,"thread_start_us":14496,"threads_started":1}
I20260812 00:20:42.906520 21658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.881723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:35691 (local address 127.0.0.1:33646)
0812 00:20:42.893508 (+ 11785us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:42.893563 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:42.893837 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:42.897247 (+ 3410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:42.897256 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:42.897294 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:42.897910 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.897928 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.900452 (+ 2524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.900457 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.903272 (+ 2815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.903286 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.905535 (+ 2249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.905541 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.905739 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.905769 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 00:20:42.905849 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 00:20:42.906011 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11493,"mutex_wait_us":239,"spinlock_wait_cycles":384,"thread_start_us":11315,"threads_started":1}
I20260812 00:20:42.907266 21662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.882491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33646 (local address 127.18.163.194:35691)
0812 00:20:42.895019 (+ 12528us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:42.895032 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:42.895075 (+ 43us) server_negotiation.cc:407] Connection header received
0812 00:20:42.895210 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:42.895218 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:42.895550 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:42.897536 (+ 1986us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:42.898185 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.900303 (+ 2118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.903483 (+ 3180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.905006 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.905196 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.905380 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:42.906802 (+ 1422us) server_negotiation.cc:299] Negotiation successful
0812 00:20:42.907015 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12285,"thread_start_us":12120,"threads_started":1}
I20260812 00:20:42.908833 21659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.882560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:39499 (local address 127.0.0.1:55872)
0812 00:20:42.896955 (+ 14395us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:42.897034 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:42.897176 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:42.897975 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:42.897979 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:42.898006 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:42.898611 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.898626 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.900276 (+ 1650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.900281 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.904354 (+ 4073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.904370 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.906696 (+ 2326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.906702 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.906919 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.906963 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 00:20:42.908227 (+ 1264us) client_negotiation.cc:240] Negotiation successful
0812 00:20:42.908388 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14266,"mutex_wait_us":236,"spinlock_wait_cycles":4352,"thread_start_us":13215,"threads_started":1}
I20260812 00:20:42.909718 21664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.883157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55872 (local address 127.18.163.193:39499)
0812 00:20:42.895501 (+ 12344us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:42.895514 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:42.897320 (+ 1806us) server_negotiation.cc:407] Connection header received
0812 00:20:42.897439 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:42.897449 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:42.897733 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:42.897972 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:42.898837 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.900133 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.904563 (+ 4430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.906090 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.906305 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.906498 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:42.909171 (+ 2673us) server_negotiation.cc:299] Negotiation successful
0812 00:20:42.909397 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12122,"thread_start_us":11939,"threads_started":1}
I20260812 00:20:42.910876 21411 tablet_service.cc:1467] Processing CreateTablet for tablet 50929c5e74164b86b3422872d4f43102 (DEFAULT_TABLE table=test-table [id=20c6e04284ee45e2b724e92198b5aa40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:42.910789 21564 tablet_service.cc:1467] Processing CreateTablet for tablet 50929c5e74164b86b3422872d4f43102 (DEFAULT_TABLE table=test-table [id=20c6e04284ee45e2b724e92198b5aa40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:42.912138 21411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50929c5e74164b86b3422872d4f43102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:42.912137 21564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50929c5e74164b86b3422872d4f43102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:42.918134 21253 tablet_service.cc:1467] Processing CreateTablet for tablet 50929c5e74164b86b3422872d4f43102 (DEFAULT_TABLE table=test-table [id=20c6e04284ee45e2b724e92198b5aa40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:42.920511 21253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50929c5e74164b86b3422872d4f43102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:42.934113 21665 tablet_bootstrap.cc:492] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7: Bootstrap starting.
I20260812 00:20:42.938452 21665 tablet_bootstrap.cc:654] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:42.939952 21665 log.cc:824] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7: Log is configured to *not* fsync() on all Append() calls
I20260812 00:20:42.944347 21666 tablet_bootstrap.cc:492] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4: Bootstrap starting.
I20260812 00:20:42.945132 21665 tablet_bootstrap.cc:492] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7: No bootstrap required, opened a new log
I20260812 00:20:42.945458 21665 ts_tablet_manager.cc:1397] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.000s
I20260812 00:20:42.946223 21668 tablet_bootstrap.cc:492] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb: Bootstrap starting.
I20260812 00:20:42.948472 21666 tablet_bootstrap.cc:654] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:42.949354 21668 tablet_bootstrap.cc:654] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:42.949955 21666 log.cc:824] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:20:42.950852 21668 log.cc:824] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb: Log is configured to *not* fsync() on all Append() calls
I20260812 00:20:42.954515 21668 tablet_bootstrap.cc:492] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb: No bootstrap required, opened a new log
I20260812 00:20:42.954877 21668 ts_tablet_manager.cc:1397] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260812 00:20:42.955729 21666 tablet_bootstrap.cc:492] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4: No bootstrap required, opened a new log
I20260812 00:20:42.956038 21666 ts_tablet_manager.cc:1397] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260812 00:20:42.956869 21665 raft_consensus.cc:348] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } }
I20260812 00:20:42.957412 21665 raft_consensus.cc:374] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:42.957542 21665 raft_consensus.cc:729] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81d0f7307a83413283fd4359523be6c7, State: Initialized, Role: FOLLOWER
I20260812 00:20:42.958297 21665 consensus_queue.cc:260] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } }
I20260812 00:20:42.959689 21489 heartbeater.cc:503] Master 127.18.163.254:44799 was elected leader, sending a full tablet report...
I20260812 00:20:42.960417 21665 ts_tablet_manager.cc:1428] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260812 00:20:42.965150 21666 raft_consensus.cc:348] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } }
I20260812 00:20:42.965188 21668 raft_consensus.cc:348] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } }
I20260812 00:20:42.965659 21666 raft_consensus.cc:374] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:42.965703 21668 raft_consensus.cc:374] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:42.965799 21666 raft_consensus.cc:729] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6b1855cbdb0499c92ba2f3e758ba2a4, State: Initialized, Role: FOLLOWER
I20260812 00:20:42.965823 21668 raft_consensus.cc:729] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca390bb32ace462b8eb99dda189f06eb, State: Initialized, Role: FOLLOWER
I20260812 00:20:42.966678 21668 consensus_queue.cc:260] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } }
I20260812 00:20:42.966682 21666 consensus_queue.cc:260] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } }
I20260812 00:20:42.968637 21645 heartbeater.cc:503] Master 127.18.163.254:44799 was elected leader, sending a full tablet report...
I20260812 00:20:42.969597 21666 ts_tablet_manager.cc:1428] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4: Time spent starting tablet: real 0.013s user 0.010s sys 0.005s
I20260812 00:20:42.969906 21668 ts_tablet_manager.cc:1428] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
I20260812 00:20:42.983765 21672 raft_consensus.cc:482] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:20:42.984174 21672 raft_consensus.cc:504] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } }
I20260812 00:20:42.986204 21672 leader_election.cc:288] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81d0f7307a83413283fd4359523be6c7 (127.18.163.194:35691), e6b1855cbdb0499c92ba2f3e758ba2a4 (127.18.163.195:45815)
I20260812 00:20:42.994230 21663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.986786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:35241 (local address 127.18.163.195:45815)
0812 00:20:42.987036 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:42.987045 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:42.987756 (+ 711us) server_negotiation.cc:407] Connection header received
0812 00:20:42.988003 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:42.988007 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:42.988073 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:42.988174 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:42.988826 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.989692 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.992333 (+ 2641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.993126 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.993342 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.993435 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:42.993800 (+ 365us) server_negotiation.cc:299] Negotiation successful
0812 00:20:42.993938 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:20:42.994268 21662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.986709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:45015 (local address 127.18.163.194:35691)
0812 00:20:42.987009 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:42.987018 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:42.987854 (+ 836us) server_negotiation.cc:407] Connection header received
0812 00:20:42.988060 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:42.988064 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:42.988129 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:42.988234 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:42.988916 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.989719 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.992342 (+ 2623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.993137 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.993348 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.993442 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:42.993837 (+ 395us) server_negotiation.cc:299] Negotiation successful
0812 00:20:42.993983 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260812 00:20:42.994573 21675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.986556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:45815 (local address 127.18.163.193:35241)
0812 00:20:42.987630 (+ 1074us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:42.987647 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:42.987846 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:42.988191 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:42.988196 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:42.988231 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:42.988661 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.988675 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.989835 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.989841 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.992144 (+ 2303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.992160 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.993398 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.993405 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.993562 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.993653 (+ 91us) client_negotiation.cc:769] Sending connection context
0812 00:20:42.993766 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 00:20:42.993922 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":950,"mutex_wait_us":50,"thread_start_us":742,"threads_started":1}
I20260812 00:20:42.994853 21674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:42.986623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:35691 (local address 127.18.163.193:45015)
0812 00:20:42.987733 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:42.987748 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:42.987913 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:42.988247 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:42.988253 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:42.988275 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:42.988732 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.988741 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.989862 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.989869 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.992168 (+ 2299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:42.992181 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:42.993454 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:42.993464 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:42.993668 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:42.993701 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 00:20:42.993805 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 00:20:42.993943 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":964,"mutex_wait_us":8,"thread_start_us":610,"threads_started":1}
I20260812 00:20:42.995805 21586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50929c5e74164b86b3422872d4f43102" candidate_uuid: "ca390bb32ace462b8eb99dda189f06eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" is_pre_election: true
I20260812 00:20:42.996006 21439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50929c5e74164b86b3422872d4f43102" candidate_uuid: "ca390bb32ace462b8eb99dda189f06eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81d0f7307a83413283fd4359523be6c7" is_pre_election: true
I20260812 00:20:42.996534 21586 raft_consensus.cc:2454] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca390bb32ace462b8eb99dda189f06eb in term 0.
I20260812 00:20:42.996551 21439 raft_consensus.cc:2454] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca390bb32ace462b8eb99dda189f06eb in term 0.
I20260812 00:20:42.997434 21197 leader_election.cc:302] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 81d0f7307a83413283fd4359523be6c7, ca390bb32ace462b8eb99dda189f06eb, e6b1855cbdb0499c92ba2f3e758ba2a4; no voters:
I20260812 00:20:42.998019 21672 raft_consensus.cc:2781] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:20:42.998208 21672 raft_consensus.cc:482] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:20:42.998349 21672 raft_consensus.cc:3037] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:43.000794 21672 raft_consensus.cc:504] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } }
I20260812 00:20:43.001520 21672 leader_election.cc:288] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [CANDIDATE]: Term 1 election: Requested vote from peers 81d0f7307a83413283fd4359523be6c7 (127.18.163.194:35691), e6b1855cbdb0499c92ba2f3e758ba2a4 (127.18.163.195:45815)
I20260812 00:20:43.002126 21439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50929c5e74164b86b3422872d4f43102" candidate_uuid: "ca390bb32ace462b8eb99dda189f06eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81d0f7307a83413283fd4359523be6c7"
I20260812 00:20:43.002218 21586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50929c5e74164b86b3422872d4f43102" candidate_uuid: "ca390bb32ace462b8eb99dda189f06eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4"
I20260812 00:20:43.002314 21439 raft_consensus.cc:3037] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:43.002478 21586 raft_consensus.cc:3037] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:43.005204 21439 raft_consensus.cc:2454] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca390bb32ace462b8eb99dda189f06eb in term 1.
I20260812 00:20:43.005406 21586 raft_consensus.cc:2454] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca390bb32ace462b8eb99dda189f06eb in term 1.
I20260812 00:20:43.005754 21197 leader_election.cc:302] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81d0f7307a83413283fd4359523be6c7, ca390bb32ace462b8eb99dda189f06eb; no voters:
I20260812 00:20:43.006083 21672 raft_consensus.cc:2781] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:20:43.006561 21672 raft_consensus.cc:686] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [term 1 LEADER]: Becoming Leader. State: Replica: ca390bb32ace462b8eb99dda189f06eb, State: Running, Role: LEADER
I20260812 00:20:43.007074 21672 consensus_queue.cc:237] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } }
I20260812 00:20:43.012372 21096 catalog_manager.cc:5495] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb reported cstate change: term changed from 0 to 1, leader changed from <none> to ca390bb32ace462b8eb99dda189f06eb (127.18.163.193). New cstate: current_term: 1 leader_uuid: "ca390bb32ace462b8eb99dda189f06eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } health_report { overall_health: HEALTHY } } }
W20260812 00:20:43.040685 21646 tablet.cc:2369] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 00:20:43 dist-test-slave-njxd krb5kdc[21045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494040, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:43.077787 21520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:43.060543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33264 (local address 127.18.163.254:44799)
0812 00:20:43.060757 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:43.060773 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:43.061423 (+ 650us) server_negotiation.cc:407] Connection header received
0812 00:20:43.061644 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:43.061648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:43.061713 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:43.061815 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:43.063174 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.063943 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.065261 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.065844 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.065947 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:43.070200 (+ 4253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:43.070210 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:43.070218 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:43.070266 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:43.074474 (+ 4208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:43.075402 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:43.075407 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:43.075411 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:43.075550 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:43.076006 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:43.076011 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:43.076014 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:43.076384 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:43.076542 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:43.076998 (+ 456us) server_negotiation.cc:299] Negotiation successful
0812 00:20:43.077412 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":197,"server-negotiator.queue_time_us":81}
I20260812 00:20:43.077837 21687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:43.060528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44799 (local address 127.0.0.1:33264)
0812 00:20:43.061317 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:43.061336 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:43.061478 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:43.061897 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:43.061903 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:43.062734 (+ 831us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:43.063010 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:43.063021 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.064090 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.064095 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:43.065121 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:43.065133 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.066022 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.066027 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:43.066152 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:43.066832 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:43.066852 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:43.069928 (+ 3076us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:43.074666 (+ 4738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:43.074707 (+ 41us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:43.074734 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:43.075259 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:43.075681 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:43.075686 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:43.075690 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:43.075878 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:43.076533 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:43.076542 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:43.076735 (+ 193us) client_negotiation.cc:769] Sending connection context
0812 00:20:43.076913 (+ 178us) client_negotiation.cc:240] Negotiation successful
0812 00:20:43.077281 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"mutex_wait_us":4,"thread_start_us":412,"threads_started":1}
I20260812 00:20:43.083739 21096 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:33264:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 00:20:43.084944 21096 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:20:43.092025 21253 tablet_service.cc:1467] Processing CreateTablet for tablet de8ebac919b24587b7f5f53ab5c07025 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d8685626f6ab4ba4bcbc3d6c469067c2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:20:43.092507 21564 tablet_service.cc:1467] Processing CreateTablet for tablet de8ebac919b24587b7f5f53ab5c07025 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d8685626f6ab4ba4bcbc3d6c469067c2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:20:43.092523 21411 tablet_service.cc:1467] Processing CreateTablet for tablet de8ebac919b24587b7f5f53ab5c07025 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d8685626f6ab4ba4bcbc3d6c469067c2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:20:43.093169 21253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de8ebac919b24587b7f5f53ab5c07025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:43.093425 21564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de8ebac919b24587b7f5f53ab5c07025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:43.093442 21411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de8ebac919b24587b7f5f53ab5c07025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:43.099424 21665 tablet_bootstrap.cc:492] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7: Bootstrap starting.
I20260812 00:20:43.101019 21666 tablet_bootstrap.cc:492] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4: Bootstrap starting.
I20260812 00:20:43.101382 21665 tablet_bootstrap.cc:654] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:43.101832 21668 tablet_bootstrap.cc:492] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb: Bootstrap starting.
I20260812 00:20:43.103035 21666 tablet_bootstrap.cc:654] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:43.103451 21668 tablet_bootstrap.cc:654] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:43.104477 21665 tablet_bootstrap.cc:492] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7: No bootstrap required, opened a new log
I20260812 00:20:43.104630 21665 ts_tablet_manager.cc:1397] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260812 00:20:43.105639 21665 raft_consensus.cc:348] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.105927 21665 raft_consensus.cc:374] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:43.106040 21665 raft_consensus.cc:729] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81d0f7307a83413283fd4359523be6c7, State: Initialized, Role: FOLLOWER
I20260812 00:20:43.106144 21668 tablet_bootstrap.cc:492] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb: No bootstrap required, opened a new log
I20260812 00:20:43.106199 21666 tablet_bootstrap.cc:492] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4: No bootstrap required, opened a new log
I20260812 00:20:43.106300 21668 ts_tablet_manager.cc:1397] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260812 00:20:43.106407 21666 ts_tablet_manager.cc:1397] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.002s
I20260812 00:20:43.106359 21665 consensus_queue.cc:260] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.106891 21671 tablet_replica.cc:439] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } }
I20260812 00:20:43.107347 21671 tablet_replica.cc:442] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:20:43.107200 21668 raft_consensus.cc:348] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.107447 21668 raft_consensus.cc:374] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:43.107300 21666 raft_consensus.cc:348] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.107544 21668 raft_consensus.cc:729] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca390bb32ace462b8eb99dda189f06eb, State: Initialized, Role: FOLLOWER
I20260812 00:20:43.107568 21666 raft_consensus.cc:374] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:43.107681 21666 raft_consensus.cc:729] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6b1855cbdb0499c92ba2f3e758ba2a4, State: Initialized, Role: FOLLOWER
I20260812 00:20:43.107873 21665 ts_tablet_manager.cc:1428] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:20:43.107805 21668 consensus_queue.cc:260] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.107903 21666 consensus_queue.cc:260] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.108414 21668 ts_tablet_manager.cc:1428] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:20:43.108531 21666 ts_tablet_manager.cc:1428] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260812 00:20:43.108429 21673 tablet_replica.cc:439] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } }
I20260812 00:20:43.108830 21673 tablet_replica.cc:442] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:20:43.108740 21672 tablet_replica.cc:439] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } }
I20260812 00:20:43.109020 21672 tablet_replica.cc:442] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 00:20:43.115599 21336 tablet.cc:2369] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:20:43.134892 21673 raft_consensus.cc:482] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:20:43.135213 21673 raft_consensus.cc:504] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.136976 21673 leader_election.cc:288] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca390bb32ace462b8eb99dda189f06eb (127.18.163.193:39499), 81d0f7307a83413283fd4359523be6c7 (127.18.163.194:35691)
I20260812 00:20:43.144004 21664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:43.137362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:53713 (local address 127.18.163.193:39499)
0812 00:20:43.137628 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:43.137636 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:43.137849 (+ 213us) server_negotiation.cc:407] Connection header received
0812 00:20:43.138178 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:43.138184 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:43.138268 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:43.138391 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:43.138887 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.139804 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.142092 (+ 2288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.143031 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.143226 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:43.143309 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:43.143597 (+ 288us) server_negotiation.cc:299] Negotiation successful
0812 00:20:43.143738 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 00:20:43.144048 21521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:43.137362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:39499 (local address 127.18.163.195:53713)
0812 00:20:43.137721 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:43.137743 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:43.137917 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:43.138422 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:43.138429 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:43.138479 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:43.138726 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:43.138740 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.139947 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.139951 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:43.141882 (+ 1931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:43.141900 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.143211 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.143217 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:43.143415 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:43.143442 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 00:20:43.143568 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 00:20:43.143718 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":3}
I20260812 00:20:43.144876 21691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:43.137630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:35691 (local address 127.18.163.195:53387)
0812 00:20:43.138449 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:43.138468 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:43.138603 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:43.139019 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:43.139023 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:43.139054 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:20:43.139465 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:43.139475 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.140702 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.140708 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:43.142709 (+ 2001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:43.142730 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.143983 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.143990 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:43.144224 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:43.144284 (+ 60us) client_negotiation.cc:769] Sending connection context
0812 00:20:43.144382 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 00:20:43.144521 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":487,"threads_started":1}
I20260812 00:20:43.144891 21662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:43.137788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:53387 (local address 127.18.163.194:35691)
0812 00:20:43.138071 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:43.138080 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:43.138587 (+ 507us) server_negotiation.cc:407] Connection header received
0812 00:20:43.138750 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:43.138754 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:43.138852 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:43.138957 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:20:43.139645 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.140539 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.142912 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.143710 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.143916 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:43.144002 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:43.144437 (+ 435us) server_negotiation.cc:299] Negotiation successful
0812 00:20:43.144577 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260812 00:20:43.145200 21285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de8ebac919b24587b7f5f53ab5c07025" candidate_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca390bb32ace462b8eb99dda189f06eb" is_pre_election: true
I20260812 00:20:43.145565 21439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de8ebac919b24587b7f5f53ab5c07025" candidate_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81d0f7307a83413283fd4359523be6c7" is_pre_election: true
I20260812 00:20:43.145750 21285 raft_consensus.cc:2454] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6b1855cbdb0499c92ba2f3e758ba2a4 in term 0.
I20260812 00:20:43.145874 21439 raft_consensus.cc:2454] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6b1855cbdb0499c92ba2f3e758ba2a4 in term 0.
I20260812 00:20:43.146420 21511 leader_election.cc:302] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81d0f7307a83413283fd4359523be6c7, e6b1855cbdb0499c92ba2f3e758ba2a4; no voters:
I20260812 00:20:43.146855 21673 raft_consensus.cc:2781] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:20:43.147019 21673 raft_consensus.cc:482] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:20:43.147153 21673 raft_consensus.cc:3037] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:43.149530 21673 raft_consensus.cc:504] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.150344 21673 leader_election.cc:288] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [CANDIDATE]: Term 1 election: Requested vote from peers ca390bb32ace462b8eb99dda189f06eb (127.18.163.193:39499), 81d0f7307a83413283fd4359523be6c7 (127.18.163.194:35691)
I20260812 00:20:43.150892 21285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de8ebac919b24587b7f5f53ab5c07025" candidate_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca390bb32ace462b8eb99dda189f06eb"
I20260812 00:20:43.150918 21439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de8ebac919b24587b7f5f53ab5c07025" candidate_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81d0f7307a83413283fd4359523be6c7"
I20260812 00:20:43.151125 21285 raft_consensus.cc:3037] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:43.151166 21439 raft_consensus.cc:3037] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:43.153862 21439 raft_consensus.cc:2454] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b1855cbdb0499c92ba2f3e758ba2a4 in term 1.
I20260812 00:20:43.153926 21285 raft_consensus.cc:2454] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b1855cbdb0499c92ba2f3e758ba2a4 in term 1.
I20260812 00:20:43.154453 21510 leader_election.cc:302] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca390bb32ace462b8eb99dda189f06eb, e6b1855cbdb0499c92ba2f3e758ba2a4; no voters:
I20260812 00:20:43.154819 21673 raft_consensus.cc:2781] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:20:43.155339 21673 raft_consensus.cc:686] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 LEADER]: Becoming Leader. State: Replica: e6b1855cbdb0499c92ba2f3e758ba2a4, State: Running, Role: LEADER
I20260812 00:20:43.155877 21673 consensus_queue.cc:237] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.159701 21692 tablet_replica.cc:439] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4: TxnStatusTablet state changed. Reason: New leader e6b1855cbdb0499c92ba2f3e758ba2a4. Latest consensus state: current_term: 1 leader_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } }
I20260812 00:20:43.160156 21692 tablet_replica.cc:442] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:20:43.160954 21694 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 00:20:43.161244 21694 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 00:20:43.161264 21094 catalog_manager.cc:5495] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6b1855cbdb0499c92ba2f3e758ba2a4 (127.18.163.195). New cstate: current_term: 1 leader_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } health_report { overall_health: HEALTHY } } }
I20260812 00:20:43.181686 21687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:43.174848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:45815 (local address 127.0.0.1:43412)
0812 00:20:43.175072 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:43.175098 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:43.175212 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:43.175773 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:43.175777 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:43.175787 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:20:43.175940 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:43.175947 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.177516 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.177519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:43.178604 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:43.178617 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.179685 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.179690 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:43.179908 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:43.180030 (+ 122us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:20:43.181153 (+ 1123us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:20:43.181171 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 00:20:43.181230 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 00:20:43.181373 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 00:20:43.181728 21663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:43.174944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43412 (local address 127.18.163.195:45815)
0812 00:20:43.175172 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:43.175178 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:43.175203 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:20:43.175432 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:43.175438 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:43.175553 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:43.175742 (+ 189us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:20:43.176105 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.177378 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.178760 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.179515 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.179659 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:43.180248 (+ 589us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:20:43.181027 (+ 779us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:20:43.181196 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:43.181259 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 00:20:43.181368 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:20:43.191105 21285 raft_consensus.cc:1261] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb [term 1 FOLLOWER]: Refusing update from remote peer e6b1855cbdb0499c92ba2f3e758ba2a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:20:43.191517 21439 raft_consensus.cc:1261] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Refusing update from remote peer e6b1855cbdb0499c92ba2f3e758ba2a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:20:43.192353 21692 consensus_queue.cc:1035] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:20:43.192720 21673 consensus_queue.cc:1035] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 00:20:43.209086 21490 tablet.cc:2369] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:20:43.211385 21672 tablet_replica.cc:439] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb: TxnStatusTablet state changed. Reason: New leader e6b1855cbdb0499c92ba2f3e758ba2a4. Latest consensus state: current_term: 1 leader_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } }
I20260812 00:20:43.211776 21672 tablet_replica.cc:442] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:20:43.212093 21699 mvcc.cc:205] Tried to move back new op lower bound from 7317479600899215360 to 7317479600770461696. Current Snapshot: MvccSnapshot[applied={T|T < 7317479600899215360}]
I20260812 00:20:43.214316 21671 tablet_replica.cc:439] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7: TxnStatusTablet state changed. Reason: New leader e6b1855cbdb0499c92ba2f3e758ba2a4. Latest consensus state: current_term: 1 leader_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } }
I20260812 00:20:43.214782 21671 tablet_replica.cc:442] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:20:43.218636 21671 tablet_replica.cc:439] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } }
I20260812 00:20:43.218917 21671 tablet_replica.cc:442] T de8ebac919b24587b7f5f53ab5c07025 P 81d0f7307a83413283fd4359523be6c7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:20:43.218321 21673 tablet_replica.cc:439] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } }
I20260812 00:20:43.219435 21673 tablet_replica.cc:442] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:20:43.223672 21673 tablet_replica.cc:439] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } }
I20260812 00:20:43.224076 21673 tablet_replica.cc:442] T de8ebac919b24587b7f5f53ab5c07025 P e6b1855cbdb0499c92ba2f3e758ba2a4: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:20:43.228276 21700 mvcc.cc:205] Tried to move back new op lower bound from 7317479600899215360 to 7317479600770461696. Current Snapshot: MvccSnapshot[applied={T|T < 7317479600899215360}]
I20260812 00:20:43.237382 21701 mvcc.cc:205] Tried to move back new op lower bound from 7317479600899215360 to 7317479600770461696. Current Snapshot: MvccSnapshot[applied={T|T < 7317479600899215360}]
I20260812 00:20:43.255427 21664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:43.244841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55880 (local address 127.18.163.193:39499)
0812 00:20:43.245094 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:43.245103 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:43.245129 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:20:43.245288 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:43.245297 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:43.245455 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:43.245759 (+ 304us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:20:43.246601 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.248250 (+ 1649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.251389 (+ 3139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.252401 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.252578 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:43.253794 (+ 1216us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:20:43.254648 (+ 854us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:20:43.254823 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:43.254936 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 00:20:43.255054 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 00:20:43.255321 21672 tablet_replica.cc:439] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } } }
I20260812 00:20:43.255653 21672 tablet_replica.cc:442] T de8ebac919b24587b7f5f53ab5c07025 P ca390bb32ace462b8eb99dda189f06eb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:20:43.275786 21711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:43.268474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:45815 (local address 127.18.163.193:46329)
0812 00:20:43.269285 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:43.269302 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:43.269494 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:43.270001 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:43.270007 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:43.270020 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:20:43.270340 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:43.270349 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.272308 (+ 1959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.272312 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:43.273411 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:43.273424 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.274508 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.274513 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:43.274650 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:43.274723 (+ 73us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:20:43.275269 (+ 546us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:20:43.275278 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 00:20:43.275342 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 00:20:43.275463 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":440,"threads_started":1}
I20260812 00:20:43.275795 21663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:43.268658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:46329 (local address 127.18.163.195:45815)
0812 00:20:43.268855 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:43.268861 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:43.269396 (+ 535us) server_negotiation.cc:407] Connection header received
0812 00:20:43.269688 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:43.269695 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:43.269807 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:43.269915 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:20:43.270521 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.272137 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.273566 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.274299 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.274445 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:43.274970 (+ 525us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:20:43.275160 (+ 190us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:20:43.275259 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:43.275401 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 00:20:43.275494 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 00:20:43.288709 21586 raft_consensus.cc:1261] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 FOLLOWER]: Refusing update from remote peer ca390bb32ace462b8eb99dda189f06eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:20:43.289614 21438 raft_consensus.cc:1261] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Refusing update from remote peer ca390bb32ace462b8eb99dda189f06eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:20:43.289681 21676 consensus_queue.cc:1035] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:20:43.290266 21672 consensus_queue.cc:1035] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:20:43.337486 21664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:43.330038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:41709 (local address 127.18.163.193:39499)
0812 00:20:43.330249 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:43.330256 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:43.330947 (+ 691us) server_negotiation.cc:407] Connection header received
0812 00:20:43.331277 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:43.331283 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:43.331379 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:43.331479 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:20:43.332149 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.333147 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.335283 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.335919 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.336005 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:43.336739 (+ 734us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:20:43.336876 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:20:43.336981 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:43.337165 (+ 184us) server_negotiation.cc:299] Negotiation successful
0812 00:20:43.337240 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 00:20:43.337785 21719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:43.330095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:39499 (local address 127.18.163.195:41709)
0812 00:20:43.330829 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:43.330856 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:43.331077 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:43.331510 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:43.331515 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:43.331528 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:20:43.331963 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:43.331973 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.333278 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.333284 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:43.335086 (+ 1802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:43.335105 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.336216 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.336226 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:43.336434 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:43.336524 (+ 90us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:20:43.337003 (+ 479us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:20:43.337031 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 00:20:43.337135 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 00:20:43.337307 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":349,"threads_started":1}
I20260812 00:20:43.381114 21094 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:20:43.381471 21094 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:20:43.386319 21094 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee: Sending DeleteTablet for 3 replicas of tablet 50929c5e74164b86b3422872d4f43102
I20260812 00:20:43.387672 21411 tablet_service.cc:1514] Processing DeleteTablet for tablet 50929c5e74164b86b3422872d4f43102 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:43 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:33646
I20260812 00:20:43.387691 21564 tablet_service.cc:1514] Processing DeleteTablet for tablet 50929c5e74164b86b3422872d4f43102 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:43 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:43406
I20260812 00:20:43.389384 21253 tablet_service.cc:1514] Processing DeleteTablet for tablet 50929c5e74164b86b3422872d4f43102 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:43 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:55872
I20260812 00:20:43.398629 21094 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33258:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:20:43.399477 21094 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:20:43.399538 21725 tablet_replica.cc:330] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb: stopping tablet replica
I20260812 00:20:43.400615 21725 raft_consensus.cc:2229] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:20:43.405994 21723 tablet_replica.cc:330] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7: stopping tablet replica
I20260812 00:20:43.406778 21724 tablet_replica.cc:330] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4: stopping tablet replica
I20260812 00:20:43.407663 21725 raft_consensus.cc:2258] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:20:43.408315 21723 raft_consensus.cc:2229] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:20:43.408906 21724 raft_consensus.cc:2229] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:20:43.411001 21253 tablet_service.cc:1467] Processing CreateTablet for tablet 722981a71bc44a8584e1998173e917f9 (DEFAULT_TABLE table=test-table [id=36d2d1029222481fa27cea10b18f753f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:43.411571 21253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 722981a71bc44a8584e1998173e917f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:43.411890 21723 raft_consensus.cc:2258] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:20:43.412663 21724 raft_consensus.cc:2258] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:20:43.413600 21725 ts_tablet_manager.cc:1905] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:20:43.414247 21411 tablet_service.cc:1467] Processing CreateTablet for tablet 722981a71bc44a8584e1998173e917f9 (DEFAULT_TABLE table=test-table [id=36d2d1029222481fa27cea10b18f753f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:43.414839 21411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 722981a71bc44a8584e1998173e917f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:43.417321 21723 ts_tablet_manager.cc:1905] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:20:43.418978 21668 tablet_bootstrap.cc:492] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb: Bootstrap starting.
I20260812 00:20:43.419346 21562 tablet_service.cc:1467] Processing CreateTablet for tablet 722981a71bc44a8584e1998173e917f9 (DEFAULT_TABLE table=test-table [id=36d2d1029222481fa27cea10b18f753f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:43.420140 21562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 722981a71bc44a8584e1998173e917f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:43.421558 21668 tablet_bootstrap.cc:654] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:43.428162 21723 ts_tablet_manager.cc:1918] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:20:43.428414 21723 log.cc:1196] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/50929c5e74164b86b3422872d4f43102
I20260812 00:20:43.429050 21723 ts_tablet_manager.cc:1939] T 50929c5e74164b86b3422872d4f43102 P 81d0f7307a83413283fd4359523be6c7: Deleting consensus metadata
I20260812 00:20:43.431253 21079 catalog_manager.cc:4841] TS 81d0f7307a83413283fd4359523be6c7 (127.18.163.194:35691): tablet 50929c5e74164b86b3422872d4f43102 (table test-table [id=20c6e04284ee45e2b724e92198b5aa40]) successfully deleted
I20260812 00:20:43.432512 21666 tablet_bootstrap.cc:492] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4: Bootstrap starting.
I20260812 00:20:43.431373 21724 ts_tablet_manager.cc:1905] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:20:43.434487 21666 tablet_bootstrap.cc:654] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:43.435220 21665 tablet_bootstrap.cc:492] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7: Bootstrap starting.
I20260812 00:20:43.436275 21725 ts_tablet_manager.cc:1918] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:20:43.436492 21725 log.cc:1196] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/50929c5e74164b86b3422872d4f43102
I20260812 00:20:43.437036 21665 tablet_bootstrap.cc:654] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:43.437096 21725 ts_tablet_manager.cc:1939] T 50929c5e74164b86b3422872d4f43102 P ca390bb32ace462b8eb99dda189f06eb: Deleting consensus metadata
I20260812 00:20:43.450233 21077 catalog_manager.cc:4841] TS ca390bb32ace462b8eb99dda189f06eb (127.18.163.193:39499): tablet 50929c5e74164b86b3422872d4f43102 (table test-table [id=20c6e04284ee45e2b724e92198b5aa40]) successfully deleted
I20260812 00:20:43.451413 21666 tablet_bootstrap.cc:492] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4: No bootstrap required, opened a new log
I20260812 00:20:43.451645 21724 ts_tablet_manager.cc:1918] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:20:43.451702 21668 tablet_bootstrap.cc:492] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb: No bootstrap required, opened a new log
I20260812 00:20:43.451726 21666 ts_tablet_manager.cc:1397] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.007s
I20260812 00:20:43.451941 21668 ts_tablet_manager.cc:1397] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb: Time spent bootstrapping tablet: real 0.033s user 0.012s sys 0.001s
I20260812 00:20:43.451968 21724 log.cc:1196] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/50929c5e74164b86b3422872d4f43102
I20260812 00:20:43.452713 21724 ts_tablet_manager.cc:1939] T 50929c5e74164b86b3422872d4f43102 P e6b1855cbdb0499c92ba2f3e758ba2a4: Deleting consensus metadata
I20260812 00:20:43.452970 21666 raft_consensus.cc:348] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.453325 21666 raft_consensus.cc:374] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:43.453447 21666 raft_consensus.cc:729] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6b1855cbdb0499c92ba2f3e758ba2a4, State: Initialized, Role: FOLLOWER
I20260812 00:20:43.453876 21666 consensus_queue.cc:260] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.454439 21668 raft_consensus.cc:348] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.454735 21668 raft_consensus.cc:374] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:43.454836 21668 raft_consensus.cc:729] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca390bb32ace462b8eb99dda189f06eb, State: Initialized, Role: FOLLOWER
I20260812 00:20:43.455178 21080 catalog_manager.cc:4841] TS e6b1855cbdb0499c92ba2f3e758ba2a4 (127.18.163.195:45815): tablet 50929c5e74164b86b3422872d4f43102 (table test-table [id=20c6e04284ee45e2b724e92198b5aa40]) successfully deleted
I20260812 00:20:43.455121 21668 consensus_queue.cc:260] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.455794 21668 ts_tablet_manager.cc:1428] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260812 00:20:43.457481 21666 ts_tablet_manager.cc:1428] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260812 00:20:43.458539 21665 tablet_bootstrap.cc:492] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7: No bootstrap required, opened a new log
I20260812 00:20:43.458753 21665 ts_tablet_manager.cc:1397] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.011s
I20260812 00:20:43.459674 21665 raft_consensus.cc:348] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.459951 21665 raft_consensus.cc:374] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:43.460049 21665 raft_consensus.cc:729] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81d0f7307a83413283fd4359523be6c7, State: Initialized, Role: FOLLOWER
I20260812 00:20:43.460316 21665 consensus_queue.cc:260] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.462049 21665 ts_tablet_manager.cc:1428] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 00:20:43.502236 21712 raft_consensus.cc:482] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:20:43.502504 21712 raft_consensus.cc:504] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.503508 21712 leader_election.cc:288] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca390bb32ace462b8eb99dda189f06eb (127.18.163.193:39499), 81d0f7307a83413283fd4359523be6c7 (127.18.163.194:35691)
I20260812 00:20:43.504204 21285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "722981a71bc44a8584e1998173e917f9" candidate_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca390bb32ace462b8eb99dda189f06eb" is_pre_election: true
I20260812 00:20:43.504551 21285 raft_consensus.cc:2454] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6b1855cbdb0499c92ba2f3e758ba2a4 in term 0.
I20260812 00:20:43.504439 21438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "722981a71bc44a8584e1998173e917f9" candidate_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81d0f7307a83413283fd4359523be6c7" is_pre_election: true
I20260812 00:20:43.504767 21438 raft_consensus.cc:2454] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6b1855cbdb0499c92ba2f3e758ba2a4 in term 0.
I20260812 00:20:43.505200 21510 leader_election.cc:302] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca390bb32ace462b8eb99dda189f06eb, e6b1855cbdb0499c92ba2f3e758ba2a4; no voters:
I20260812 00:20:43.505563 21712 raft_consensus.cc:2781] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:20:43.505735 21712 raft_consensus.cc:482] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:20:43.505857 21712 raft_consensus.cc:3037] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:43.508383 21712 raft_consensus.cc:504] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.509673 21712 leader_election.cc:288] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [CANDIDATE]: Term 1 election: Requested vote from peers ca390bb32ace462b8eb99dda189f06eb (127.18.163.193:39499), 81d0f7307a83413283fd4359523be6c7 (127.18.163.194:35691)
I20260812 00:20:43.509816 21438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "722981a71bc44a8584e1998173e917f9" candidate_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81d0f7307a83413283fd4359523be6c7"
I20260812 00:20:43.510071 21438 raft_consensus.cc:3037] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:43.512670 21438 raft_consensus.cc:2454] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b1855cbdb0499c92ba2f3e758ba2a4 in term 1.
I20260812 00:20:43.513279 21511 leader_election.cc:302] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81d0f7307a83413283fd4359523be6c7, e6b1855cbdb0499c92ba2f3e758ba2a4; no voters:
I20260812 00:20:43.513257 21285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "722981a71bc44a8584e1998173e917f9" candidate_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca390bb32ace462b8eb99dda189f06eb"
I20260812 00:20:43.513706 21712 raft_consensus.cc:2781] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:20:43.513526 21285 raft_consensus.cc:3037] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:43.514281 21712 raft_consensus.cc:686] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 LEADER]: Becoming Leader. State: Replica: e6b1855cbdb0499c92ba2f3e758ba2a4, State: Running, Role: LEADER
I20260812 00:20:43.514660 21712 consensus_queue.cc:237] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:43.517491 21285 raft_consensus.cc:2454] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b1855cbdb0499c92ba2f3e758ba2a4 in term 1.
I20260812 00:20:43.522172 21094 catalog_manager.cc:5495] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6b1855cbdb0499c92ba2f3e758ba2a4 (127.18.163.195). New cstate: current_term: 1 leader_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } health_report { overall_health: HEALTHY } } }
I20260812 00:20:43.561652 21663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:43.555827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43424 (local address 127.18.163.195:45815)
0812 00:20:43.556011 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:43.556022 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:43.556070 (+ 48us) server_negotiation.cc:407] Connection header received
0812 00:20:43.556331 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:43.556337 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:43.556443 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:43.556573 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:20:43.556992 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.557970 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.559413 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.559943 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.560142 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:43.560692 (+ 550us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:20:43.560839 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:20:43.560953 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:43.561121 (+ 168us) server_negotiation.cc:299] Negotiation successful
0812 00:20:43.561217 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 00:20:43.577338 21719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:43.571996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:45815 (local address 127.18.163.195:48991)
0812 00:20:43.572270 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:43.572297 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:43.572451 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:43.572776 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:43.572784 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:43.572795 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:20:43.573088 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:43.573098 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.574263 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.574270 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:43.575353 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:43.575367 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.576123 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.576132 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:43.576321 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:43.576359 (+ 38us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:20:43.576758 (+ 399us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:20:43.576770 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 00:20:43.576850 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 00:20:43.577030 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":96}
I20260812 00:20:43.577338 21663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:43.572019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:48991 (local address 127.18.163.195:45815)
0812 00:20:43.572198 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:43.572204 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:43.572371 (+ 167us) server_negotiation.cc:407] Connection header received
0812 00:20:43.572592 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:43.572600 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:43.572668 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:43.572763 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:20:43.573223 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.574118 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.575503 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:43.575959 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:43.576100 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:43.576542 (+ 442us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:20:43.576654 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:20:43.576758 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:43.576866 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 00:20:43.576970 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":47}
I20260812 00:20:43.589918 21438 raft_consensus.cc:1261] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Refusing update from remote peer e6b1855cbdb0499c92ba2f3e758ba2a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:20:43.590602 21285 raft_consensus.cc:1261] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb [term 1 FOLLOWER]: Refusing update from remote peer e6b1855cbdb0499c92ba2f3e758ba2a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:20:43.590579 21712 consensus_queue.cc:1035] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:20:43.591226 21712 consensus_queue.cc:1035] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 00:20:43.639917 21699 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 00:20:45.261335 21094 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:20:45.261677 21094 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:20:45.266048 21094 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee: Sending DeleteTablet for 3 replicas of tablet 722981a71bc44a8584e1998173e917f9
I20260812 00:20:45.267066 21253 tablet_service.cc:1514] Processing DeleteTablet for tablet 722981a71bc44a8584e1998173e917f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:45 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:55872
I20260812 00:20:45.267346 21562 tablet_service.cc:1514] Processing DeleteTablet for tablet 722981a71bc44a8584e1998173e917f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:45 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:43406
I20260812 00:20:45.267396 21411 tablet_service.cc:1514] Processing DeleteTablet for tablet 722981a71bc44a8584e1998173e917f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:45 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:33646
I20260812 00:20:45.277776 21756 tablet_replica.cc:330] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4: stopping tablet replica
I20260812 00:20:45.278007 21754 tablet_replica.cc:330] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb: stopping tablet replica
I20260812 00:20:45.278205 21756 raft_consensus.cc:2229] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:20:45.278258 21754 raft_consensus.cc:2229] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:20:45.278569 21754 raft_consensus.cc:2258] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:20:45.279328 21755 tablet_replica.cc:330] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7: stopping tablet replica
I20260812 00:20:45.279332 21756 raft_consensus.cc:2258] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:20:45.279570 21755 raft_consensus.cc:2229] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:20:45.279932 21755 raft_consensus.cc:2258] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:20:45.280848 21754 ts_tablet_manager.cc:1905] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:20:45.281914 21756 ts_tablet_manager.cc:1905] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:20:45.281914 21755 ts_tablet_manager.cc:1905] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:20:45.288857 21754 ts_tablet_manager.cc:1918] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:20:45.289028 21756 ts_tablet_manager.cc:1918] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:20:45.289028 21755 ts_tablet_manager.cc:1918] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:20:45.289113 21754 log.cc:1196] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/722981a71bc44a8584e1998173e917f9
I20260812 00:20:45.289175 21755 log.cc:1196] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/722981a71bc44a8584e1998173e917f9
I20260812 00:20:45.289292 21756 log.cc:1196] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/722981a71bc44a8584e1998173e917f9
I20260812 00:20:45.289644 21754 ts_tablet_manager.cc:1939] T 722981a71bc44a8584e1998173e917f9 P ca390bb32ace462b8eb99dda189f06eb: Deleting consensus metadata
I20260812 00:20:45.289767 21755 ts_tablet_manager.cc:1939] T 722981a71bc44a8584e1998173e917f9 P 81d0f7307a83413283fd4359523be6c7: Deleting consensus metadata
I20260812 00:20:45.289850 21756 ts_tablet_manager.cc:1939] T 722981a71bc44a8584e1998173e917f9 P e6b1855cbdb0499c92ba2f3e758ba2a4: Deleting consensus metadata
I20260812 00:20:45.291086 21079 catalog_manager.cc:4841] TS 81d0f7307a83413283fd4359523be6c7 (127.18.163.194:35691): tablet 722981a71bc44a8584e1998173e917f9 (table test-table [id=36d2d1029222481fa27cea10b18f753f]) successfully deleted
I20260812 00:20:45.291184 21077 catalog_manager.cc:4841] TS ca390bb32ace462b8eb99dda189f06eb (127.18.163.193:39499): tablet 722981a71bc44a8584e1998173e917f9 (table test-table [id=36d2d1029222481fa27cea10b18f753f]) successfully deleted
I20260812 00:20:45.291086 21080 catalog_manager.cc:4841] TS e6b1855cbdb0499c92ba2f3e758ba2a4 (127.18.163.195:45815): tablet 722981a71bc44a8584e1998173e917f9 (table test-table [id=36d2d1029222481fa27cea10b18f753f]) successfully deleted
Aug 12 00:20:45 dist-test-slave-njxd krb5kdc[21045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494045, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:20:45 dist-test-slave-njxd krb5kdc[21045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494045, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:45.336313 21764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:45.321538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33280 (local address 127.18.163.254:44799)
0812 00:20:45.322273 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:45.322277 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:45.322301 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:20:45.322362 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:45.322366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:45.322430 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:45.322529 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:45.323918 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:45.324732 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:45.326091 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:45.326525 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:45.326656 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:45.330715 (+ 4059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:45.330721 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:45.330725 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:45.330767 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:45.333563 (+ 2796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:45.334346 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:45.334351 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:45.334353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:45.334515 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:45.334922 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:45.334926 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:45.334928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:45.335231 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:45.335431 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:45.335708 (+ 277us) server_negotiation.cc:299] Negotiation successful
0812 00:20:45.335890 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":367,"threads_started":1}
I20260812 00:20:45.340183 21094 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33280:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:20:45.340754 21094 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:20:45.347864 21253 tablet_service.cc:1467] Processing CreateTablet for tablet 02b7a9ca8793471f82df0618cb13fc5d (DEFAULT_TABLE table=test-table [id=0ad1a43a19744e6f9a40166b218c1d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:45.347990 21411 tablet_service.cc:1467] Processing CreateTablet for tablet 02b7a9ca8793471f82df0618cb13fc5d (DEFAULT_TABLE table=test-table [id=0ad1a43a19744e6f9a40166b218c1d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:45.348173 21562 tablet_service.cc:1467] Processing CreateTablet for tablet 02b7a9ca8793471f82df0618cb13fc5d (DEFAULT_TABLE table=test-table [id=0ad1a43a19744e6f9a40166b218c1d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:45.348412 21253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02b7a9ca8793471f82df0618cb13fc5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:45.348412 21411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02b7a9ca8793471f82df0618cb13fc5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:45.348680 21562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02b7a9ca8793471f82df0618cb13fc5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:45.353732 21765 tablet_bootstrap.cc:492] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4: Bootstrap starting.
I20260812 00:20:45.355804 21765 tablet_bootstrap.cc:654] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:45.355803 21767 tablet_bootstrap.cc:492] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7: Bootstrap starting.
I20260812 00:20:45.356854 21766 tablet_bootstrap.cc:492] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb: Bootstrap starting.
I20260812 00:20:45.358013 21767 tablet_bootstrap.cc:654] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:45.358690 21765 tablet_bootstrap.cc:492] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4: No bootstrap required, opened a new log
I20260812 00:20:45.358875 21765 ts_tablet_manager.cc:1397] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 00:20:45.359112 21766 tablet_bootstrap.cc:654] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:45.359841 21765 raft_consensus.cc:348] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.360124 21765 raft_consensus.cc:374] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:45.360260 21765 raft_consensus.cc:729] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6b1855cbdb0499c92ba2f3e758ba2a4, State: Initialized, Role: FOLLOWER
I20260812 00:20:45.360358 21767 tablet_bootstrap.cc:492] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7: No bootstrap required, opened a new log
I20260812 00:20:45.360517 21767 ts_tablet_manager.cc:1397] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 00:20:45.360632 21765 consensus_queue.cc:260] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.361469 21765 ts_tablet_manager.cc:1428] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:20:45.362155 21767 raft_consensus.cc:348] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.362502 21767 raft_consensus.cc:374] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:45.362622 21767 raft_consensus.cc:729] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81d0f7307a83413283fd4359523be6c7, State: Initialized, Role: FOLLOWER
I20260812 00:20:45.362947 21767 consensus_queue.cc:260] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.364105 21767 ts_tablet_manager.cc:1428] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:20:45.365935 21766 tablet_bootstrap.cc:492] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb: No bootstrap required, opened a new log
I20260812 00:20:45.366145 21766 ts_tablet_manager.cc:1397] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260812 00:20:45.366942 21766 raft_consensus.cc:348] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.367169 21766 raft_consensus.cc:374] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:45.367282 21766 raft_consensus.cc:729] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca390bb32ace462b8eb99dda189f06eb, State: Initialized, Role: FOLLOWER
I20260812 00:20:45.367584 21766 consensus_queue.cc:260] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.368515 21766 ts_tablet_manager.cc:1428] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260812 00:20:45.370905 21692 raft_consensus.cc:482] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:20:45.371126 21692 raft_consensus.cc:504] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.371863 21692 leader_election.cc:288] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca390bb32ace462b8eb99dda189f06eb (127.18.163.193:39499), 81d0f7307a83413283fd4359523be6c7 (127.18.163.194:35691)
I20260812 00:20:45.372380 21285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02b7a9ca8793471f82df0618cb13fc5d" candidate_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca390bb32ace462b8eb99dda189f06eb" is_pre_election: true
I20260812 00:20:45.372447 21438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02b7a9ca8793471f82df0618cb13fc5d" candidate_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81d0f7307a83413283fd4359523be6c7" is_pre_election: true
I20260812 00:20:45.372629 21285 raft_consensus.cc:2454] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6b1855cbdb0499c92ba2f3e758ba2a4 in term 0.
I20260812 00:20:45.372714 21438 raft_consensus.cc:2454] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6b1855cbdb0499c92ba2f3e758ba2a4 in term 0.
I20260812 00:20:45.373133 21510 leader_election.cc:302] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca390bb32ace462b8eb99dda189f06eb, e6b1855cbdb0499c92ba2f3e758ba2a4; no voters:
I20260812 00:20:45.373487 21692 raft_consensus.cc:2781] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:20:45.373620 21692 raft_consensus.cc:482] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:20:45.373744 21692 raft_consensus.cc:3037] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:45.376163 21692 raft_consensus.cc:504] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.376837 21692 leader_election.cc:288] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [CANDIDATE]: Term 1 election: Requested vote from peers ca390bb32ace462b8eb99dda189f06eb (127.18.163.193:39499), 81d0f7307a83413283fd4359523be6c7 (127.18.163.194:35691)
I20260812 00:20:45.377252 21285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02b7a9ca8793471f82df0618cb13fc5d" candidate_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca390bb32ace462b8eb99dda189f06eb"
I20260812 00:20:45.377324 21438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02b7a9ca8793471f82df0618cb13fc5d" candidate_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81d0f7307a83413283fd4359523be6c7"
I20260812 00:20:45.377460 21285 raft_consensus.cc:3037] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:45.377606 21438 raft_consensus.cc:3037] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:45.379623 21285 raft_consensus.cc:2454] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b1855cbdb0499c92ba2f3e758ba2a4 in term 1.
I20260812 00:20:45.379817 21438 raft_consensus.cc:2454] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b1855cbdb0499c92ba2f3e758ba2a4 in term 1.
I20260812 00:20:45.380153 21510 leader_election.cc:302] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca390bb32ace462b8eb99dda189f06eb, e6b1855cbdb0499c92ba2f3e758ba2a4; no voters:
I20260812 00:20:45.380471 21692 raft_consensus.cc:2781] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:20:45.380697 21692 raft_consensus.cc:686] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 LEADER]: Becoming Leader. State: Replica: e6b1855cbdb0499c92ba2f3e758ba2a4, State: Running, Role: LEADER
I20260812 00:20:45.380981 21692 consensus_queue.cc:237] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.383795 21095 catalog_manager.cc:5495] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6b1855cbdb0499c92ba2f3e758ba2a4 (127.18.163.195). New cstate: current_term: 1 leader_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } health_report { overall_health: HEALTHY } } }
I20260812 00:20:45.407529 21776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:45.401721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43426 (local address 127.18.163.195:45815)
0812 00:20:45.402328 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:45.402333 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:45.402351 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:20:45.402404 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:45.402407 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:45.402471 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:45.402583 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:20:45.403029 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:45.403959 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:45.405447 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:45.406003 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:45.406144 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:45.406679 (+ 535us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:20:45.406817 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:20:45.406926 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:45.407077 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 00:20:45.407161 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":305,"threads_started":1}
I20260812 00:20:45.417315 21285 raft_consensus.cc:1261] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb [term 1 FOLLOWER]: Refusing update from remote peer e6b1855cbdb0499c92ba2f3e758ba2a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:20:45.417318 21438 raft_consensus.cc:1261] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Refusing update from remote peer e6b1855cbdb0499c92ba2f3e758ba2a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:20:45.417933 21741 consensus_queue.cc:1035] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:20:45.418270 21692 consensus_queue.cc:1035] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:20:45.464617 21096 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33280:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:20:45.464921 21096 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33280:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:20:45.468197 21096 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee: Sending DeleteTablet for 3 replicas of tablet 02b7a9ca8793471f82df0618cb13fc5d
I20260812 00:20:45.469312 21564 tablet_service.cc:1514] Processing DeleteTablet for tablet 02b7a9ca8793471f82df0618cb13fc5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:45 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:43406
I20260812 00:20:45.469358 21411 tablet_service.cc:1514] Processing DeleteTablet for tablet 02b7a9ca8793471f82df0618cb13fc5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:45 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:33646
I20260812 00:20:45.469374 21253 tablet_service.cc:1514] Processing DeleteTablet for tablet 02b7a9ca8793471f82df0618cb13fc5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:45 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:55872
I20260812 00:20:45.469661 21756 tablet_replica.cc:330] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4: stopping tablet replica
I20260812 00:20:45.469729 21754 tablet_replica.cc:330] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb: stopping tablet replica
I20260812 00:20:45.469903 21756 raft_consensus.cc:2229] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:20:45.469954 21754 raft_consensus.cc:2229] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:20:45.470163 21754 raft_consensus.cc:2258] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:20:45.470320 21756 raft_consensus.cc:2258] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:20:45.470670 21755 tablet_replica.cc:330] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7: stopping tablet replica
I20260812 00:20:45.470602 21096 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33280:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 00:20:45.470896 21755 raft_consensus.cc:2229] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:20:45.471097 21755 raft_consensus.cc:2258] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 00:20:45.471340 21096 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:20:45.471485 21754 ts_tablet_manager.cc:1905] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:20:45.472223 21755 ts_tablet_manager.cc:1905] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:20:45.473694 21756 ts_tablet_manager.cc:1905] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:20:45.479159 21755 ts_tablet_manager.cc:1918] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:20:45.479353 21755 log.cc:1196] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/02b7a9ca8793471f82df0618cb13fc5d
I20260812 00:20:45.479794 21755 ts_tablet_manager.cc:1939] T 02b7a9ca8793471f82df0618cb13fc5d P 81d0f7307a83413283fd4359523be6c7: Deleting consensus metadata
I20260812 00:20:45.480018 21754 ts_tablet_manager.cc:1918] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:20:45.480254 21754 log.cc:1196] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/02b7a9ca8793471f82df0618cb13fc5d
I20260812 00:20:45.480787 21754 ts_tablet_manager.cc:1939] T 02b7a9ca8793471f82df0618cb13fc5d P ca390bb32ace462b8eb99dda189f06eb: Deleting consensus metadata
I20260812 00:20:45.481096 21079 catalog_manager.cc:4841] TS 81d0f7307a83413283fd4359523be6c7 (127.18.163.194:35691): tablet 02b7a9ca8793471f82df0618cb13fc5d (table test-table [id=0ad1a43a19744e6f9a40166b218c1d18]) successfully deleted
I20260812 00:20:45.481386 21756 ts_tablet_manager.cc:1918] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:20:45.481562 21756 log.cc:1196] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/02b7a9ca8793471f82df0618cb13fc5d
I20260812 00:20:45.481914 21077 catalog_manager.cc:4841] TS ca390bb32ace462b8eb99dda189f06eb (127.18.163.193:39499): tablet 02b7a9ca8793471f82df0618cb13fc5d (table test-table [id=0ad1a43a19744e6f9a40166b218c1d18]) successfully deleted
I20260812 00:20:45.482051 21756 ts_tablet_manager.cc:1939] T 02b7a9ca8793471f82df0618cb13fc5d P e6b1855cbdb0499c92ba2f3e758ba2a4: Deleting consensus metadata
I20260812 00:20:45.482997 21080 catalog_manager.cc:4841] TS e6b1855cbdb0499c92ba2f3e758ba2a4 (127.18.163.195:45815): tablet 02b7a9ca8793471f82df0618cb13fc5d (table test-table [id=0ad1a43a19744e6f9a40166b218c1d18]) successfully deleted
I20260812 00:20:45.486423 21253 tablet_service.cc:1467] Processing CreateTablet for tablet 062b5680556245f6858cb43ab68def00 (DEFAULT_TABLE table=test-table [id=196dab62ed674cc6a9d29c58f73ab605]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:45.486783 21564 tablet_service.cc:1467] Processing CreateTablet for tablet 062b5680556245f6858cb43ab68def00 (DEFAULT_TABLE table=test-table [id=196dab62ed674cc6a9d29c58f73ab605]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:45.486931 21253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 062b5680556245f6858cb43ab68def00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:45.487234 21564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 062b5680556245f6858cb43ab68def00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:45.490093 21411 tablet_service.cc:1467] Processing CreateTablet for tablet 062b5680556245f6858cb43ab68def00 (DEFAULT_TABLE table=test-table [id=196dab62ed674cc6a9d29c58f73ab605]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:20:45.490603 21411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 062b5680556245f6858cb43ab68def00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:45.493861 21765 tablet_bootstrap.cc:492] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4: Bootstrap starting.
I20260812 00:20:45.495301 21766 tablet_bootstrap.cc:492] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb: Bootstrap starting.
I20260812 00:20:45.495625 21765 tablet_bootstrap.cc:654] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:45.496024 21767 tablet_bootstrap.cc:492] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7: Bootstrap starting.
I20260812 00:20:45.497771 21767 tablet_bootstrap.cc:654] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:45.497913 21766 tablet_bootstrap.cc:654] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:45.498278 21765 tablet_bootstrap.cc:492] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4: No bootstrap required, opened a new log
I20260812 00:20:45.498478 21765 ts_tablet_manager.cc:1397] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 00:20:45.499413 21765 raft_consensus.cc:348] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.499701 21765 raft_consensus.cc:374] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:45.499812 21765 raft_consensus.cc:729] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6b1855cbdb0499c92ba2f3e758ba2a4, State: Initialized, Role: FOLLOWER
I20260812 00:20:45.500172 21765 consensus_queue.cc:260] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.500756 21765 ts_tablet_manager.cc:1428] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:20:45.500800 21767 tablet_bootstrap.cc:492] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7: No bootstrap required, opened a new log
I20260812 00:20:45.501471 21767 ts_tablet_manager.cc:1397] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260812 00:20:45.502362 21766 tablet_bootstrap.cc:492] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb: No bootstrap required, opened a new log
I20260812 00:20:45.502274 21767 raft_consensus.cc:348] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.502498 21767 raft_consensus.cc:374] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:45.502557 21766 ts_tablet_manager.cc:1397] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260812 00:20:45.502590 21767 raft_consensus.cc:729] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81d0f7307a83413283fd4359523be6c7, State: Initialized, Role: FOLLOWER
I20260812 00:20:45.502852 21767 consensus_queue.cc:260] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.503346 21766 raft_consensus.cc:348] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.503618 21766 raft_consensus.cc:374] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:45.503721 21766 raft_consensus.cc:729] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca390bb32ace462b8eb99dda189f06eb, State: Initialized, Role: FOLLOWER
I20260812 00:20:45.504127 21766 consensus_queue.cc:260] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.504343 21767 ts_tablet_manager.cc:1428] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:20:45.504400 21773 raft_consensus.cc:482] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:20:45.504591 21773 raft_consensus.cc:504] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.505432 21773 leader_election.cc:288] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81d0f7307a83413283fd4359523be6c7 (127.18.163.194:35691), e6b1855cbdb0499c92ba2f3e758ba2a4 (127.18.163.195:45815)
I20260812 00:20:45.506076 21439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "062b5680556245f6858cb43ab68def00" candidate_uuid: "ca390bb32ace462b8eb99dda189f06eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81d0f7307a83413283fd4359523be6c7" is_pre_election: true
I20260812 00:20:45.506150 21586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "062b5680556245f6858cb43ab68def00" candidate_uuid: "ca390bb32ace462b8eb99dda189f06eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" is_pre_election: true
I20260812 00:20:45.506330 21439 raft_consensus.cc:2454] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca390bb32ace462b8eb99dda189f06eb in term 0.
I20260812 00:20:45.506412 21586 raft_consensus.cc:2454] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca390bb32ace462b8eb99dda189f06eb in term 0.
I20260812 00:20:45.506850 21197 leader_election.cc:302] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81d0f7307a83413283fd4359523be6c7, ca390bb32ace462b8eb99dda189f06eb; no voters:
I20260812 00:20:45.507172 21773 raft_consensus.cc:2781] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:20:45.507292 21773 raft_consensus.cc:482] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:20:45.507390 21773 raft_consensus.cc:3037] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:45.507582 21766 ts_tablet_manager.cc:1428] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260812 00:20:45.510572 21773 raft_consensus.cc:504] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.511267 21773 leader_election.cc:288] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [CANDIDATE]: Term 1 election: Requested vote from peers 81d0f7307a83413283fd4359523be6c7 (127.18.163.194:35691), e6b1855cbdb0499c92ba2f3e758ba2a4 (127.18.163.195:45815)
I20260812 00:20:45.511746 21439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "062b5680556245f6858cb43ab68def00" candidate_uuid: "ca390bb32ace462b8eb99dda189f06eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81d0f7307a83413283fd4359523be6c7"
I20260812 00:20:45.512004 21439 raft_consensus.cc:3037] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:45.511931 21586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "062b5680556245f6858cb43ab68def00" candidate_uuid: "ca390bb32ace462b8eb99dda189f06eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4"
I20260812 00:20:45.512169 21586 raft_consensus.cc:3037] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:45.515185 21439 raft_consensus.cc:2454] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca390bb32ace462b8eb99dda189f06eb in term 1.
I20260812 00:20:45.515190 21586 raft_consensus.cc:2454] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca390bb32ace462b8eb99dda189f06eb in term 1.
I20260812 00:20:45.515697 21197 leader_election.cc:302] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81d0f7307a83413283fd4359523be6c7, ca390bb32ace462b8eb99dda189f06eb; no voters:
I20260812 00:20:45.516077 21773 raft_consensus.cc:2781] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:20:45.516620 21773 raft_consensus.cc:686] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [term 1 LEADER]: Becoming Leader. State: Replica: ca390bb32ace462b8eb99dda189f06eb, State: Running, Role: LEADER
I20260812 00:20:45.516935 21773 consensus_queue.cc:237] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } }
I20260812 00:20:45.519692 21096 catalog_manager.cc:5495] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb reported cstate change: term changed from 0 to 1, leader changed from <none> to ca390bb32ace462b8eb99dda189f06eb (127.18.163.193). New cstate: current_term: 1 leader_uuid: "ca390bb32ace462b8eb99dda189f06eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca390bb32ace462b8eb99dda189f06eb" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 } health_report { overall_health: UNKNOWN } } }
I20260812 00:20:45.548411 21787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:45.543092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55884 (local address 127.18.163.193:39499)
0812 00:20:45.543762 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:45.543767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:45.543789 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:20:45.543852 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:45.543855 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:45.543919 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:45.544007 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:20:45.544371 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:45.545172 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:45.546552 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:45.547099 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:45.547207 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:45.547652 (+ 445us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:20:45.547774 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:20:45.547846 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:45.547988 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 00:20:45.548061 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":410,"threads_started":1}
I20260812 00:20:45.558094 21586 raft_consensus.cc:1261] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 FOLLOWER]: Refusing update from remote peer ca390bb32ace462b8eb99dda189f06eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:20:45.558360 21438 raft_consensus.cc:1261] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Refusing update from remote peer ca390bb32ace462b8eb99dda189f06eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:20:45.558876 21785 consensus_queue.cc:1035] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b1855cbdb0499c92ba2f3e758ba2a4" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:20:45.559253 21773 consensus_queue.cc:1035] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "81d0f7307a83413283fd4359523be6c7" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 35691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 00:20:45.579515 21738 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 00:20:47.176177 21094 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33280:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:20:47.176429 21094 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33280:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:20:47.181005 21094 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 298d56b47d954672b72d38ccbb04fdee: Sending DeleteTablet for 3 replicas of tablet 062b5680556245f6858cb43ab68def00
I20260812 00:20:47.181994 21253 tablet_service.cc:1514] Processing DeleteTablet for tablet 062b5680556245f6858cb43ab68def00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:47 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:55872
I20260812 00:20:47.182085 21411 tablet_service.cc:1514] Processing DeleteTablet for tablet 062b5680556245f6858cb43ab68def00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:47 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:33646
I20260812 00:20:47.182123 21564 tablet_service.cc:1514] Processing DeleteTablet for tablet 062b5680556245f6858cb43ab68def00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:20:47 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:43406
I20260812 00:20:47.182965 21816 tablet_replica.cc:330] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4: stopping tablet replica
I20260812 00:20:47.183033 21815 tablet_replica.cc:330] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb: stopping tablet replica
I20260812 00:20:47.183252 21815 raft_consensus.cc:2229] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:20:47.183454 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 21176
I20260812 00:20:47.183434 21816 raft_consensus.cc:2229] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:20:47.183707 21815 raft_consensus.cc:2258] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:20:47.183979 21816 raft_consensus.cc:2258] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:20:47.185089 21815 ts_tablet_manager.cc:1905] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:20:47.185665 21816 ts_tablet_manager.cc:1905] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:20:47.194231 21815 ts_tablet_manager.cc:1918] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:20:47.194468 21815 log.cc:1196] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/062b5680556245f6858cb43ab68def00
I20260812 00:20:47.195050 21815 ts_tablet_manager.cc:1939] T 062b5680556245f6858cb43ab68def00 P ca390bb32ace462b8eb99dda189f06eb: Deleting consensus metadata
I20260812 00:20:47.196357 21816 ts_tablet_manager.cc:1918] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:20:47.196667 21816 log.cc:1196] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/062b5680556245f6858cb43ab68def00
I20260812 00:20:47.196712 21077 catalog_manager.cc:4841] TS ca390bb32ace462b8eb99dda189f06eb (127.18.163.193:39499): tablet 062b5680556245f6858cb43ab68def00 (table test-table [id=196dab62ed674cc6a9d29c58f73ab605]) successfully deleted
I20260812 00:20:47.197551 21816 ts_tablet_manager.cc:1939] T 062b5680556245f6858cb43ab68def00 P e6b1855cbdb0499c92ba2f3e758ba2a4: Deleting consensus metadata
I20260812 00:20:47.198575 21817 tablet_replica.cc:330] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7: stopping tablet replica
I20260812 00:20:47.198839 21817 raft_consensus.cc:2229] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:20:47.199126 21817 raft_consensus.cc:2258] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:20:47.199170 21080 catalog_manager.cc:4841] TS e6b1855cbdb0499c92ba2f3e758ba2a4 (127.18.163.195:45815): tablet 062b5680556245f6858cb43ab68def00 (table test-table [id=196dab62ed674cc6a9d29c58f73ab605]) successfully deleted
I20260812 00:20:47.200381 21817 ts_tablet_manager.cc:1905] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:20:47.208112 21817 ts_tablet_manager.cc:1918] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:20:47.208319 21817 log.cc:1196] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/062b5680556245f6858cb43ab68def00
I20260812 00:20:47.208932 21817 ts_tablet_manager.cc:1939] T 062b5680556245f6858cb43ab68def00 P 81d0f7307a83413283fd4359523be6c7: Deleting consensus metadata
I20260812 00:20:47.210489 21079 catalog_manager.cc:4841] TS 81d0f7307a83413283fd4359523be6c7 (127.18.163.194:35691): tablet 062b5680556245f6858cb43ab68def00 (table test-table [id=196dab62ed674cc6a9d29c58f73ab605]) successfully deleted
Aug 12 00:20:47 dist-test-slave-njxd krb5kdc[21045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494045, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:20:47.222275 21820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:47.185754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55892 (local address 127.18.163.193:39499)
0812 00:20:47.197634 (+ 11880us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:47.197643 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:47.198446 (+ 803us) server_negotiation.cc:407] Connection header received
0812 00:20:47.198522 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:47.198526 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:47.198626 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:47.198747 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:47.200865 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:47.201716 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:47.203593 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:47.204117 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:47.204369 (+ 252us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:47.215726 (+ 11357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:47.215752 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:47.215776 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:47.215837 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:47.219105 (+ 3268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:47.220094 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:47.220102 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:47.220104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:47.220260 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:47.220669 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:47.220672 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:47.220674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:47.221056 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:47.221305 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:47.221684 (+ 379us) server_negotiation.cc:299] Negotiation successful
0812 00:20:47.221912 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11653,"thread_start_us":11498,"threads_started":1}
W20260812 00:20:47.223120 21330 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55892
W20260812 00:20:47.223861 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 21176: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:20:47.224123 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 21176
I20260812 00:20:47.256922 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 21339
Aug 12 00:20:47 dist-test-slave-njxd krb5kdc[21045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494045, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
I20260812 00:20:47.274369 21822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:47.257853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33654 (local address 127.18.163.194:35691)
0812 00:20:47.258440 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:47.258445 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:47.258463 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:20:47.258520 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:47.258524 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:47.258592 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:47.258687 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:47.260000 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:47.260754 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:47.262130 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:47.262591 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:47.262704 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:47.267811 (+ 5107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:47.267830 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:47.267847 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:47.267912 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:47.271532 (+ 3620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:47.272253 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:47.272261 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:47.272263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:47.272403 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:47.272742 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:47.272746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:47.272748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:47.273121 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:47.273348 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:47.273763 (+ 415us) server_negotiation.cc:299] Negotiation successful
0812 00:20:47.274015 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":254,"threads_started":1}
W20260812 00:20:47.275094 21483 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33654
W20260812 00:20:47.275780 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 21339: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:20:47.275959 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 21339
I20260812 00:20:47.301518 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 21493
Aug 12 00:20:47 dist-test-slave-njxd krb5kdc[21045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494045, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:20:47.319705 21823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:47.302479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43438 (local address 127.18.163.195:45815)
0812 00:20:47.303055 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:47.303059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:47.303076 (+ 17us) server_negotiation.cc:407] Connection header received
0812 00:20:47.303133 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:47.303136 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:47.303202 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:47.303301 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:47.304851 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:47.305770 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:47.307006 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:47.307420 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:47.307517 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:47.312438 (+ 4921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:47.312464 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:47.312499 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:47.312562 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:47.316294 (+ 3732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:47.317125 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:47.317135 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:47.317139 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:47.317308 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:47.317923 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:47.317926 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:47.317928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:47.318344 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:47.318685 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:47.319042 (+ 357us) server_negotiation.cc:299] Negotiation successful
0812 00:20:47.319318 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":319,"threads_started":1}
W20260812 00:20:47.320463 21639 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43438
W20260812 00:20:47.321166 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 21493: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:20:47.321395 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 21493
I20260812 00:20:47.357653 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 21059
I20260812 00:20:47.358971 21141 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:20:47.486428 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 21059
2026-08-12T00:20:47Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8490 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:20:47 dist-test-slave-njxd krb5kdc[21827](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:20:47 dist-test-slave-njxd krb5kdc[21827](info): set up 2 sockets
Aug 12 00:20:47 dist-test-slave-njxd krb5kdc[21827](info): commencing operation
krb5kdc: starting...
W20260812 00:20:48.668859 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.005s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:20:48 dist-test-slave-njxd krb5kdc[21827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494048, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:20:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:20:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:20:48.933190 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44897
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:38093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:44897
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:49.319200 21843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:49.319535 21843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:49.319631 21843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:49.327216 21843 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:20:49.327355 21843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:49.327404 21843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:49.327466 21843 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:20:49.327512 21843 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:20:49.338037 21843 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:38093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:44897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:49.339495 21843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:49.340875 21843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:49.354220 21849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:49.354315 21848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:49.354290 21851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:49.355026 21843 server_base.cc:1034] running on GCE node
I20260812 00:20:49.355912 21843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:49.357491 21843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:49.358771 21843 hybrid_clock.cc:648] HybridClock initialized: now 1786494049358691 us; error 64 us; skew 500 ppm
I20260812 00:20:49.359179 21843 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:49 dist-test-slave-njxd krb5kdc[21827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494049, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:49.362604 21843 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:20:49.364353 21843 webserver.cc:460] Webserver started at http://127.18.163.254:42987/ using document root <none> and password file <none>
I20260812 00:20:49.365155 21843 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:49.365320 21843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:49.365762 21843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:49.369073 21843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "9d83481124804981a5c1769f5b666d6f"
format_stamp: "Formatted at 2026-08-12 00:20:49 on dist-test-slave-njxd"
server_key: "7938f772a91be3dc5a098575ef1e84e1"
server_key_iv: "cc1cf027f7640491036343732d529de8"
server_key_version: "encryptionkey@0"
I20260812 00:20:49.369997 21843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "9d83481124804981a5c1769f5b666d6f"
format_stamp: "Formatted at 2026-08-12 00:20:49 on dist-test-slave-njxd"
server_key: "7938f772a91be3dc5a098575ef1e84e1"
server_key_iv: "cc1cf027f7640491036343732d529de8"
server_key_version: "encryptionkey@0"
I20260812 00:20:49.376260 21843 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.002s
I20260812 00:20:49.380273 21859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:49.381922 21843 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:20:49.382140 21843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "9d83481124804981a5c1769f5b666d6f"
format_stamp: "Formatted at 2026-08-12 00:20:49 on dist-test-slave-njxd"
server_key: "7938f772a91be3dc5a098575ef1e84e1"
server_key_iv: "cc1cf027f7640491036343732d529de8"
server_key_version: "encryptionkey@0"
I20260812 00:20:49.382378 21843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:49.400595 21843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:49.405088 21843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:49.405429 21843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:49.425509 21843 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:44897
I20260812 00:20:49.425529 21913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:44897 every 8 connection(s)
I20260812 00:20:49.427142 21843 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:20:49.430243 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 21843
I20260812 00:20:49.430537 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:20:49.431247 19087 external_mini_cluster.cc:1428] Setting key 5312dd588331c9f67023af5fc534aecb
I20260812 00:20:49.431598 21914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:49.447806 21914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f: Bootstrap starting.
Aug 12 00:20:49 dist-test-slave-njxd krb5kdc[21827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494048, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:49.451830 21914 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:49.453022 21914 log.cc:824] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:20:49.456453 21914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f: No bootstrap required, opened a new log
I20260812 00:20:49.457093 21918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:49.433415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38736 (local address 127.18.163.254:44897)
0812 00:20:49.434371 (+ 956us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:49.434384 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:49.434428 (+ 44us) server_negotiation.cc:407] Connection header received
0812 00:20:49.436781 (+ 2353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:49.436809 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:49.437295 (+ 486us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:49.437787 (+ 492us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:49.439753 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:49.441103 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:49.443121 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:49.443884 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:49.444032 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:49.449031 (+ 4999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:49.449040 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:49.449057 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:49.449103 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:49.452465 (+ 3362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:49.453260 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:49.453274 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:49.453282 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:49.453464 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:49.453934 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:49.453941 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:49.453949 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:49.454577 (+ 628us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:49.454936 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:49.455423 (+ 487us) server_negotiation.cc:299] Negotiation successful
0812 00:20:49.455899 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":724,"thread_start_us":480,"threads_started":1}
I20260812 00:20:49.465358 21914 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d83481124804981a5c1769f5b666d6f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44897 } }
I20260812 00:20:49.465898 21914 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:49.466019 21914 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d83481124804981a5c1769f5b666d6f, State: Initialized, Role: FOLLOWER
I20260812 00:20:49.466719 21914 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d83481124804981a5c1769f5b666d6f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44897 } }
I20260812 00:20:49.467008 21914 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:20:49.467181 21914 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:20:49.467379 21914 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:49.469899 21914 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d83481124804981a5c1769f5b666d6f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44897 } }
I20260812 00:20:49.470558 21914 leader_election.cc:302] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d83481124804981a5c1769f5b666d6f; no voters:
I20260812 00:20:49.471223 21914 leader_election.cc:288] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:20:49.471395 21921 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:20:49.472755 21921 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [term 1 LEADER]: Becoming Leader. State: Replica: 9d83481124804981a5c1769f5b666d6f, State: Running, Role: LEADER
I20260812 00:20:49.473338 21921 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d83481124804981a5c1769f5b666d6f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44897 } }
I20260812 00:20:49.473737 21914 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:20:49.476887 21922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d83481124804981a5c1769f5b666d6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d83481124804981a5c1769f5b666d6f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44897 } } }
I20260812 00:20:49.476833 21924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d83481124804981a5c1769f5b666d6f. Latest consensus state: current_term: 1 leader_uuid: "9d83481124804981a5c1769f5b666d6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d83481124804981a5c1769f5b666d6f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44897 } } }
I20260812 00:20:49.477372 21922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [sys.catalog]: This master's current role is: LEADER
I20260812 00:20:49.477463 21924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f [sys.catalog]: This master's current role is: LEADER
I20260812 00:20:49.479816 21929 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:20:49.485343 21929 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:20:49.495612 21929 catalog_manager.cc:1347] Generated new cluster ID: b0091fa716c348b3acc31b528a7d2fb6
I20260812 00:20:49.495766 21929 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:20:49.531301 21929 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:20:49.532783 21929 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:20:49.540125 21929 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d83481124804981a5c1769f5b666d6f: Generated new TSK 0
I20260812 00:20:49.541076 21929 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:20:49.605788 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44897
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:38093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:49.972436 21951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:49.972767 21951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:49.972940 21951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:49.981813 21951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:49.981969 21951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:49.982172 21951 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:20:49.993043 21951 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:38093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44897
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:49.994622 21951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:49.996158 21951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:50.010774 21957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:50.010737 21956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:50.011118 21959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:50.013067 21951 server_base.cc:1034] running on GCE node
I20260812 00:20:50.013888 21951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:50.014952 21951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:50.016180 21951 hybrid_clock.cc:648] HybridClock initialized: now 1786494050016130 us; error 50 us; skew 500 ppm
I20260812 00:20:50.016556 21951 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:50 dist-test-slave-njxd krb5kdc[21827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494050, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:50.020285 21951 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:20:50.022003 21951 webserver.cc:460] Webserver started at http://127.18.163.193:35891/ using document root <none> and password file <none>
I20260812 00:20:50.022768 21951 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:50.022881 21951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:50.023187 21951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:50.026870 21951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "dcb4cc6558154d78b1d4758ce94b6e5c"
format_stamp: "Formatted at 2026-08-12 00:20:50 on dist-test-slave-njxd"
server_key: "8da32edfd0f82ca0b54d25ac296ef9bb"
server_key_iv: "ee3134a14a0b2b5938d9de3073a0a3e1"
server_key_version: "encryptionkey@0"
I20260812 00:20:50.027721 21951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "dcb4cc6558154d78b1d4758ce94b6e5c"
format_stamp: "Formatted at 2026-08-12 00:20:50 on dist-test-slave-njxd"
server_key: "8da32edfd0f82ca0b54d25ac296ef9bb"
server_key_iv: "ee3134a14a0b2b5938d9de3073a0a3e1"
server_key_version: "encryptionkey@0"
I20260812 00:20:50.033713 21951 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 00:20:50.037424 21969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:50.039040 21951 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 00:20:50.039247 21951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "dcb4cc6558154d78b1d4758ce94b6e5c"
format_stamp: "Formatted at 2026-08-12 00:20:50 on dist-test-slave-njxd"
server_key: "8da32edfd0f82ca0b54d25ac296ef9bb"
server_key_iv: "ee3134a14a0b2b5938d9de3073a0a3e1"
server_key_version: "encryptionkey@0"
I20260812 00:20:50.039490 21951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:50.053947 21951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:50.058866 21951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:50.059226 21951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:50.060307 21951 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:20:50.061875 21951 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:50.061983 21951 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:50.062153 21951 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:50.062235 21951 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:50.098315 21951 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:43261
I20260812 00:20:50.098367 22093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:43261 every 8 connection(s)
I20260812 00:20:50.099749 21951 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:20:50.102576 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 21951
I20260812 00:20:50.102870 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:20:50.103736 19087 external_mini_cluster.cc:1428] Setting key a78904f5fad2068a9f670f860344d391
Aug 12 00:20:50 dist-test-slave-njxd krb5kdc[21827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494050, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:50.122651 22096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:50.102726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:33155 (local address 127.18.163.254:44897)
0812 00:20:50.103285 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:50.103290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:50.104555 (+ 1265us) server_negotiation.cc:407] Connection header received
0812 00:20:50.106579 (+ 2024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:50.106585 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:50.106689 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:50.106827 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:50.108454 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:50.109652 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:50.111508 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:50.112260 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:50.112427 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:50.116496 (+ 4069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:50.116501 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:50.116505 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:50.116543 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:50.119225 (+ 2682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:50.120037 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:50.120043 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:50.120046 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:50.120189 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:50.120657 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:50.120664 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:50.120668 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:50.120956 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:50.121124 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:50.121989 (+ 865us) server_negotiation.cc:299] Negotiation successful
0812 00:20:50.122259 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":296,"threads_started":1}
I20260812 00:20:50.123773 22097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:50.103411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44897 (local address 127.18.163.193:33155)
0812 00:20:50.104269 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:50.104319 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:50.106275 (+ 1956us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:50.107044 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:50.107053 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:50.107626 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:50.108250 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:50.108270 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:50.109944 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:50.109949 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:50.111329 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:50.111343 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:50.112509 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:50.112513 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:50.112733 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:50.113721 (+ 988us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:50.113746 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:50.116221 (+ 2475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:50.119397 (+ 3176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:50.119407 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:50.119427 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:50.119903 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:50.120312 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:50.120317 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:50.120321 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:50.120536 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:50.121094 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:50.121102 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:50.121476 (+ 374us) client_negotiation.cc:769] Sending connection context
0812 00:20:50.121869 (+ 393us) client_negotiation.cc:240] Negotiation successful
0812 00:20:50.122468 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":360,"threads_started":1}
I20260812 00:20:50.125483 22094 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44897
I20260812 00:20:50.125872 22094 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:50.126678 22094 heartbeater.cc:511] Master 127.18.163.254:44897 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
I20260812 00:20:50.129024 21878 ts_manager.cc:194] Registered new tserver with Master: dcb4cc6558154d78b1d4758ce94b6e5c (127.18.163.193:43261)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
I20260812 00:20:50.130684 21878 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:33155
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:20:50.159394 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44897
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:38093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:50.537912 22100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:50.538233 22100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:50.538419 22100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:50.546805 22100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:50.546931 22100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:50.547139 22100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:20:50.558022 22100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:38093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44897
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:50.559521 22100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:50.561061 22100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:50.576541 22107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:50.576506 22108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:50.576444 22110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:50.577486 22100 server_base.cc:1034] running on GCE node
I20260812 00:20:50.578279 22100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:50.579336 22100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:50.580607 22100 hybrid_clock.cc:648] HybridClock initialized: now 1786494050580551 us; error 52 us; skew 500 ppm
I20260812 00:20:50.580989 22100 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:50 dist-test-slave-njxd krb5kdc[21827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494050, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:50.584863 22100 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:20:50.586823 22100 webserver.cc:460] Webserver started at http://127.18.163.194:36221/ using document root <none> and password file <none>
I20260812 00:20:50.587730 22100 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:50.587903 22100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:50.588248 22100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:50.591574 22100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "7ae3d8b4b7f444f5ab7d6c858c7ff46e"
format_stamp: "Formatted at 2026-08-12 00:20:50 on dist-test-slave-njxd"
server_key: "34d427d627a92fec4bf37aef4c875ff0"
server_key_iv: "ec0f2f848ef7d6281b3f0d029108a36b"
server_key_version: "encryptionkey@0"
I20260812 00:20:50.592509 22100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "7ae3d8b4b7f444f5ab7d6c858c7ff46e"
format_stamp: "Formatted at 2026-08-12 00:20:50 on dist-test-slave-njxd"
server_key: "34d427d627a92fec4bf37aef4c875ff0"
server_key_iv: "ec0f2f848ef7d6281b3f0d029108a36b"
server_key_version: "encryptionkey@0"
I20260812 00:20:50.598763 22100 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260812 00:20:50.603135 22117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:50.604764 22100 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260812 00:20:50.605005 22100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "7ae3d8b4b7f444f5ab7d6c858c7ff46e"
format_stamp: "Formatted at 2026-08-12 00:20:50 on dist-test-slave-njxd"
server_key: "34d427d627a92fec4bf37aef4c875ff0"
server_key_iv: "ec0f2f848ef7d6281b3f0d029108a36b"
server_key_version: "encryptionkey@0"
I20260812 00:20:50.605253 22100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:50.623811 22100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:50.628933 22100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:50.629206 22100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:50.630323 22100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:20:50.631834 22100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:50.631935 22100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:50.632041 22100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:50.632087 22100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:50.669348 22100 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:36565
I20260812 00:20:50.669415 22245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:36565 every 8 connection(s)
I20260812 00:20:50.670719 22100 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:20:50.676918 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 22100
I20260812 00:20:50.677155 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:20:50.677676 19087 external_mini_cluster.cc:1428] Setting key 1efe0dfc0d8305c661d950c566ad75da
Aug 12 00:20:50 dist-test-slave-njxd krb5kdc[21827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494050, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:50.696899 22248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:50.673818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:59623 (local address 127.18.163.254:44897)
0812 00:20:50.674463 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:50.674473 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:50.675749 (+ 1276us) server_negotiation.cc:407] Connection header received
0812 00:20:50.678990 (+ 3241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:50.678996 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:50.679077 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:50.679216 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:50.681241 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:50.682095 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:50.683878 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:50.684321 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:50.684465 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:50.688686 (+ 4221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:50.688692 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:50.688695 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:50.688733 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:50.692716 (+ 3983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:50.693737 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:50.693747 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:50.693753 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:50.693969 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:50.694525 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:50.694532 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:50.694549 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:50.694995 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:50.695175 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:50.696030 (+ 855us) server_negotiation.cc:299] Negotiation successful
0812 00:20:50.696369 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":311,"threads_started":1}
I20260812 00:20:50.697719 22249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:50.674455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44897 (local address 127.18.163.194:59623)
0812 00:20:50.675530 (+ 1075us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:50.675597 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:50.678595 (+ 2998us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:50.679526 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:50.679541 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:50.680401 (+ 860us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:50.681044 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:50.681063 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:50.682315 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:50.682319 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:50.683706 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:50.683720 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:50.684585 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:50.684596 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:50.684857 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:50.685661 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:50.685699 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:50.688379 (+ 2680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:50.692956 (+ 4577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:50.692969 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:50.692994 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:50.693513 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:50.694145 (+ 632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:50.694150 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:50.694153 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:50.694376 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:50.695153 (+ 777us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:50.695160 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:50.695544 (+ 384us) client_negotiation.cc:769] Sending connection context
0812 00:20:50.695874 (+ 330us) client_negotiation.cc:240] Negotiation successful
0812 00:20:50.696340 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"thread_start_us":415,"threads_started":1}
I20260812 00:20:50.699561 22246 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44897
I20260812 00:20:50.699928 22246 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:50.700870 22246 heartbeater.cc:511] Master 127.18.163.254:44897 requested a full tablet report, sending...
I20260812 00:20:50.702845 21878 ts_manager.cc:194] Registered new tserver with Master: 7ae3d8b4b7f444f5ab7d6c858c7ff46e (127.18.163.194:36565)
I20260812 00:20:50.704211 21878 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:59623
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
I20260812 00:20:51.134315 22094 heartbeater.cc:503] Master 127.18.163.254:44897 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
W20260812 00:20:51.506043 19087 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.18.163.195: real 0.825s user 0.005s sys 0.013s
I20260812 00:20:51.507054 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44897
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:38093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:20:51.707429 22246 heartbeater.cc:503] Master 127.18.163.254:44897 was elected leader, sending a full tablet report...
W20260812 00:20:51.936259 22252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:51.936641 22252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:51.936821 22252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:51.944882 22252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:51.945053 22252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:51.945263 22252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:20:51.956188 22252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:38093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44897
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:51.957798 22252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:51.959261 22252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:51.973776 22257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:51.973826 22258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:51.973690 22261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:51.977136 22252 server_base.cc:1034] running on GCE node
I20260812 00:20:51.978008 22252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:51.979231 22252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:51.980536 22252 hybrid_clock.cc:648] HybridClock initialized: now 1786494051980458 us; error 80 us; skew 500 ppm
I20260812 00:20:51.980979 22252 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:51 dist-test-slave-njxd krb5kdc[21827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494051, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:51.985021 22252 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:20:51.987020 22252 webserver.cc:460] Webserver started at http://127.18.163.195:35009/ using document root <none> and password file <none>
I20260812 00:20:51.987903 22252 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:51.988027 22252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:51.988333 22252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:51.991959 22252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "4b730a4cb01f4800b4f0433d006e8c38"
format_stamp: "Formatted at 2026-08-12 00:20:51 on dist-test-slave-njxd"
server_key: "986aeaebc79b61b35a607b1ffb51df80"
server_key_iv: "4df9b70b43f2f4b133b24f4bb8e70a07"
server_key_version: "encryptionkey@0"
I20260812 00:20:51.992892 22252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "4b730a4cb01f4800b4f0433d006e8c38"
format_stamp: "Formatted at 2026-08-12 00:20:51 on dist-test-slave-njxd"
server_key: "986aeaebc79b61b35a607b1ffb51df80"
server_key_iv: "4df9b70b43f2f4b133b24f4bb8e70a07"
server_key_version: "encryptionkey@0"
I20260812 00:20:51.999200 22252 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 00:20:52.003410 22272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:52.005069 22252 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260812 00:20:52.005266 22252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "4b730a4cb01f4800b4f0433d006e8c38"
format_stamp: "Formatted at 2026-08-12 00:20:51 on dist-test-slave-njxd"
server_key: "986aeaebc79b61b35a607b1ffb51df80"
server_key_iv: "4df9b70b43f2f4b133b24f4bb8e70a07"
server_key_version: "encryptionkey@0"
I20260812 00:20:52.005517 22252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:52.021042 22252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:52.025897 22252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:52.026223 22252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:52.027334 22252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:20:52.028838 22252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:52.028920 22252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:52.029098 22252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:52.029151 22252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:52.067116 22252 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:40661
I20260812 00:20:52.067179 22397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:40661 every 8 connection(s)
I20260812 00:20:52.068576 22252 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:20:52.076751 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 22252
I20260812 00:20:52.076959 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:20:52.077458 19087 external_mini_cluster.cc:1428] Setting key b240c0c1edb14b99704a5135d17bf5aa
Aug 12 00:20:52 dist-test-slave-njxd krb5kdc[21827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494051, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:52.092072 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:52.071498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:33549 (local address 127.18.163.254:44897)
0812 00:20:52.072020 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:52.072026 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:52.073164 (+ 1138us) server_negotiation.cc:407] Connection header received
0812 00:20:52.075438 (+ 2274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:52.075445 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:52.075548 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:52.075684 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:52.077526 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:52.078614 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:52.080849 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:52.081299 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:52.081408 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:52.085671 (+ 4263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:52.085677 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:52.085680 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:52.085720 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:52.088481 (+ 2761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:52.089354 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:52.089360 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:52.089364 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:52.089513 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:52.090032 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:52.090037 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:52.090041 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:52.090405 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:52.090573 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:52.091357 (+ 784us) server_negotiation.cc:299] Negotiation successful
0812 00:20:52.091600 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":255,"threads_started":1}
I20260812 00:20:52.093271 22402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:52.072161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44897 (local address 127.18.163.195:33549)
0812 00:20:52.072956 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:52.073009 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:52.075057 (+ 2048us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:52.075968 (+ 911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:52.075979 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:52.076565 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:52.077319 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:52.077342 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:52.078789 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:52.078794 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:52.080667 (+ 1873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:52.080685 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:52.081518 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:52.081523 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:52.081873 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:52.082783 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:52.082809 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:52.085362 (+ 2553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:52.088658 (+ 3296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:52.088669 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:52.088689 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:52.089210 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:52.089676 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:52.089681 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:52.089685 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:52.089905 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:52.090562 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:52.090571 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:52.090975 (+ 404us) client_negotiation.cc:769] Sending connection context
0812 00:20:52.091290 (+ 315us) client_negotiation.cc:240] Negotiation successful
0812 00:20:52.091889 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":303,"threads_started":1}
I20260812 00:20:52.094871 22398 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44897
I20260812 00:20:52.095184 22398 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:52.095933 22398 heartbeater.cc:511] Master 127.18.163.254:44897 requested a full tablet report, sending...
I20260812 00:20:52.097491 21878 ts_manager.cc:194] Registered new tserver with Master: 4b730a4cb01f4800b4f0433d006e8c38 (127.18.163.195:40661)
I20260812 00:20:52.098712 21878 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:33549
I20260812 00:20:52.106266 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 00:20:52.150547 22400 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:20:52.147829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56158 (local address 127.18.163.254:44897)
0812 00:20:52.148028 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:52.148033 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:52.148587 (+ 554us) server_negotiation.cc:407] Connection header received
0812 00:20:52.148744 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:52.148748 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:52.148834 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:52.148930 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:52.150339 (+ 1409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56158: BlockingRecv error: recv got EOF from 127.0.0.1:56158 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 00:20:52.154511 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 21951
W20260812 00:20:52.157428 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 21951: Not authorized: Client connection negotiation failed: client connection to 127.18.163.193:43261: server requires authentication, but client does not have Kerberos credentials available
I20260812 00:20:52.157758 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 21951
I20260812 00:20:52.180550 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 22100
W20260812 00:20:52.183842 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 22100: Not authorized: Client connection negotiation failed: client connection to 127.18.163.194:36565: server requires authentication, but client does not have Kerberos credentials available
I20260812 00:20:52.183992 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 22100
I20260812 00:20:52.205857 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 22252
W20260812 00:20:52.208918 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 22252: Not authorized: Client connection negotiation failed: client connection to 127.18.163.195:40661: server requires authentication, but client does not have Kerberos credentials available
I20260812 00:20:52.209065 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 22252
I20260812 00:20:52.234742 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 21843
I20260812 00:20:52.236166 21909 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:20:52.346721 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 21843
2026-08-12T00:20:52Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4856 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:20:52 dist-test-slave-njxd krb5kdc[22419](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:20:52 dist-test-slave-njxd krb5kdc[22419](info): set up 2 sockets
Aug 12 00:20:52 dist-test-slave-njxd krb5kdc[22419](info): commencing operation
krb5kdc: starting...
W20260812 00:20:53.539151 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.007s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:20:53 dist-test-slave-njxd krb5kdc[22419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:20:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:20:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:20:53.805378 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:46501
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:37353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:46501
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:54.168116 22434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:54.168440 22434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:54.168536 22434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:54.175966 22434 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:20:54.176102 22434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:54.176151 22434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:54.176211 22434 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:20:54.176262 22434 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:20:54.186452 22434 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:37353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:46501
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:46501
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:54.187848 22434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:54.189236 22434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:54.202375 22439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:54.202286 22440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:54.202442 22442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:54.203510 22434 server_base.cc:1034] running on GCE node
I20260812 00:20:54.204783 22434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:54.207065 22434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:54.208428 22434 hybrid_clock.cc:648] HybridClock initialized: now 1786494054208375 us; error 85 us; skew 500 ppm
I20260812 00:20:54.208827 22434 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:54 dist-test-slave-njxd krb5kdc[22419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494054, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:54.212539 22434 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:20:54.214318 22434 webserver.cc:460] Webserver started at http://127.18.163.254:35057/ using document root <none> and password file <none>
I20260812 00:20:54.215130 22434 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:54.215292 22434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:54.215649 22434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:54.219122 22434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "eda46ec2e88346d39053a9e265a2aa4e"
format_stamp: "Formatted at 2026-08-12 00:20:54 on dist-test-slave-njxd"
server_key: "6c1bea56436c3d91556a8831eaaddb3a"
server_key_iv: "4eb8e02039eed3431d8b0a769901c21f"
server_key_version: "encryptionkey@0"
I20260812 00:20:54.220034 22434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "eda46ec2e88346d39053a9e265a2aa4e"
format_stamp: "Formatted at 2026-08-12 00:20:54 on dist-test-slave-njxd"
server_key: "6c1bea56436c3d91556a8831eaaddb3a"
server_key_iv: "4eb8e02039eed3431d8b0a769901c21f"
server_key_version: "encryptionkey@0"
I20260812 00:20:54.226138 22434 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 00:20:54.230011 22449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:54.231648 22434 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:20:54.231865 22434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "eda46ec2e88346d39053a9e265a2aa4e"
format_stamp: "Formatted at 2026-08-12 00:20:54 on dist-test-slave-njxd"
server_key: "6c1bea56436c3d91556a8831eaaddb3a"
server_key_iv: "4eb8e02039eed3431d8b0a769901c21f"
server_key_version: "encryptionkey@0"
I20260812 00:20:54.232105 22434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:54.244915 22434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:54.249394 22434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:54.249801 22434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:54.270637 22434 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:46501
I20260812 00:20:54.270674 22509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:46501 every 8 connection(s)
I20260812 00:20:54.272179 22434 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:20:54.272612 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 22434
I20260812 00:20:54.272869 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:20:54.273751 19087 external_mini_cluster.cc:1428] Setting key 4631c07c694617bb7f40a21bc087f110
I20260812 00:20:54.277025 22510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 00:20:54 dist-test-slave-njxd krb5kdc[22419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:54.291683 22510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e: Bootstrap starting.
I20260812 00:20:54.296240 22510 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:54.297569 22510 log.cc:824] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:20:54.299938 22514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:54.275820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37316 (local address 127.18.163.254:46501)
0812 00:20:54.276737 (+ 917us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:54.276750 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:54.276798 (+ 48us) server_negotiation.cc:407] Connection header received
0812 00:20:54.278651 (+ 1853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:54.278675 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:54.279087 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:54.279433 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:54.281459 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:54.282939 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:54.284753 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:54.285466 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:54.285686 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:54.290789 (+ 5103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:54.290802 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:54.290824 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:54.290885 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:54.295100 (+ 4215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:54.295962 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:54.295990 (+ 28us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:54.296001 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:54.296205 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:54.296734 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:54.296738 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:54.296740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:54.297346 (+ 606us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:54.297630 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:54.298183 (+ 553us) server_negotiation.cc:299] Negotiation successful
0812 00:20:54.298739 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":671,"thread_start_us":413,"threads_started":1}
I20260812 00:20:54.300935 22510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e: No bootstrap required, opened a new log
I20260812 00:20:54.304502 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:20:54.309795 22510 raft_consensus.cc:348] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eda46ec2e88346d39053a9e265a2aa4e" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46501 } }
I20260812 00:20:54.310281 22510 raft_consensus.cc:374] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:54.310402 22510 raft_consensus.cc:729] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda46ec2e88346d39053a9e265a2aa4e, State: Initialized, Role: FOLLOWER
I20260812 00:20:54.311040 22510 consensus_queue.cc:260] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eda46ec2e88346d39053a9e265a2aa4e" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46501 } }
I20260812 00:20:54.311331 22510 raft_consensus.cc:388] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:20:54.311491 22510 raft_consensus.cc:482] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:20:54.311679 22510 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:54.314287 22510 raft_consensus.cc:504] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eda46ec2e88346d39053a9e265a2aa4e" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46501 } }
I20260812 00:20:54.315047 22510 leader_election.cc:302] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eda46ec2e88346d39053a9e265a2aa4e; no voters:
I20260812 00:20:54.315730 22510 leader_election.cc:288] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:20:54.315954 22517 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:20:54.317031 22517 raft_consensus.cc:686] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [term 1 LEADER]: Becoming Leader. State: Replica: eda46ec2e88346d39053a9e265a2aa4e, State: Running, Role: LEADER
I20260812 00:20:54.317776 22517 consensus_queue.cc:237] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eda46ec2e88346d39053a9e265a2aa4e" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46501 } }
I20260812 00:20:54.318127 22510 sys_catalog.cc:564] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:20:54.324069 22519 sys_catalog.cc:455] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader eda46ec2e88346d39053a9e265a2aa4e. Latest consensus state: current_term: 1 leader_uuid: "eda46ec2e88346d39053a9e265a2aa4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eda46ec2e88346d39053a9e265a2aa4e" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46501 } } }
I20260812 00:20:54.324589 22519 sys_catalog.cc:458] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [sys.catalog]: This master's current role is: LEADER
I20260812 00:20:54.324056 22518 sys_catalog.cc:455] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eda46ec2e88346d39053a9e265a2aa4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eda46ec2e88346d39053a9e265a2aa4e" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46501 } } }
I20260812 00:20:54.325104 22518 sys_catalog.cc:458] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e [sys.catalog]: This master's current role is: LEADER
I20260812 00:20:54.338466 22525 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:20:54.344826 22525 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:20:54.369807 22525 catalog_manager.cc:1347] Generated new cluster ID: 254aa78531104617b709c206141ed36c
I20260812 00:20:54.370100 22525 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:20:54.382740 22525 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:20:54.384066 22525 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:20:54.388682 22514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:54.378832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37320 (local address 127.18.163.254:46501)
0812 00:20:54.379030 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:54.379037 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:54.379653 (+ 616us) server_negotiation.cc:407] Connection header received
0812 00:20:54.379858 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:54.379864 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:54.379955 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:54.380093 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:54.381512 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:54.382546 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:54.384550 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:54.385312 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:54.385464 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:54.386859 (+ 1395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:54.386865 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:54.386870 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:20:54.387713 (+ 843us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:54.387790 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:20:54.387823 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:54.387958 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:54.388146 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 00:20:54.388290 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:20:54.393289 22525 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eda46ec2e88346d39053a9e265a2aa4e: Generated new TSK 0
I20260812 00:20:54.394316 22525 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:20:54.402788 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 22434
I20260812 00:20:54.404023 22504 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:20:54.495471 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 22434
2026-08-12T00:20:54Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2142 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:20:54 dist-test-slave-njxd krb5kdc[22547](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:20:54 dist-test-slave-njxd krb5kdc[22547](info): set up 2 sockets
Aug 12 00:20:54 dist-test-slave-njxd krb5kdc[22547](info): commencing operation
krb5kdc: starting...
W20260812 00:20:55.673141 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.002s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:20:55 dist-test-slave-njxd krb5kdc[22547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:20:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:20:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:20:55.941237 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:45645
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:45645
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:56.293215 22561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:56.293555 22561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:56.293761 22561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:56.301507 22561 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:20:56.301759 22561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:56.301875 22561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:56.301992 22561 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:20:56.302080 22561 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:20:56.312680 22561 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:45645
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:45645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:56.314240 22561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:56.315696 22561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:56.328398 22566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:56.328349 22569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:56.328476 22567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:56.329676 22561 server_base.cc:1034] running on GCE node
I20260812 00:20:56.330543 22561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:56.332197 22561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:56.333425 22561 hybrid_clock.cc:648] HybridClock initialized: now 1786494056333350 us; error 63 us; skew 500 ppm
I20260812 00:20:56.333837 22561 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:56 dist-test-slave-njxd krb5kdc[22547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494056, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:56.337438 22561 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:20:56.339211 22561 webserver.cc:460] Webserver started at http://127.18.163.254:45975/ using document root <none> and password file <none>
I20260812 00:20:56.340015 22561 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:56.340173 22561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:56.340540 22561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:56.344004 22561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "dd3acfbae309417aaab42ef052557693"
format_stamp: "Formatted at 2026-08-12 00:20:56 on dist-test-slave-njxd"
server_key: "a89f8910f35c1d7f7e67ffacec84ecb8"
server_key_iv: "579dc2732133d4d0c7a6f6cafc9fb8ad"
server_key_version: "encryptionkey@0"
I20260812 00:20:56.344910 22561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "dd3acfbae309417aaab42ef052557693"
format_stamp: "Formatted at 2026-08-12 00:20:56 on dist-test-slave-njxd"
server_key: "a89f8910f35c1d7f7e67ffacec84ecb8"
server_key_iv: "579dc2732133d4d0c7a6f6cafc9fb8ad"
server_key_version: "encryptionkey@0"
I20260812 00:20:56.351032 22561 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260812 00:20:56.354943 22578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:56.356492 22561 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260812 00:20:56.356719 22561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "dd3acfbae309417aaab42ef052557693"
format_stamp: "Formatted at 2026-08-12 00:20:56 on dist-test-slave-njxd"
server_key: "a89f8910f35c1d7f7e67ffacec84ecb8"
server_key_iv: "579dc2732133d4d0c7a6f6cafc9fb8ad"
server_key_version: "encryptionkey@0"
I20260812 00:20:56.356958 22561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:56.389441 22561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:56.394451 22561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:56.394826 22561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:56.415041 22561 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:45645
I20260812 00:20:56.415063 22635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:45645 every 8 connection(s)
I20260812 00:20:56.416651 22561 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:20:56.420275 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 22561
I20260812 00:20:56.420545 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:20:56.421013 22636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:20:56.421285 19087 external_mini_cluster.cc:1428] Setting key 82b5a33ad9763755544dd586c6aec692
I20260812 00:20:56.437059 22636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693: Bootstrap starting.
Aug 12 00:20:56 dist-test-slave-njxd krb5kdc[22547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:56.441923 22636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693: Neither blocks nor log segments found. Creating new log.
I20260812 00:20:56.443547 22636 log.cc:824] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693: Log is configured to *not* fsync() on all Append() calls
I20260812 00:20:56.447908 22636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693: No bootstrap required, opened a new log
I20260812 00:20:56.449069 22639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:56.423671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41470 (local address 127.18.163.254:45645)
0812 00:20:56.424651 (+ 980us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:56.424669 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:56.424728 (+ 59us) server_negotiation.cc:407] Connection header received
0812 00:20:56.426699 (+ 1971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:56.426734 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:56.427359 (+ 625us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:56.427875 (+ 516us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:56.429270 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:56.431312 (+ 2042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:56.432772 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:56.434026 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:56.434273 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:56.438738 (+ 4465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:56.438753 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:56.438777 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:56.438848 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:56.443292 (+ 4444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:56.444347 (+ 1055us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:56.444362 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:56.444371 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:56.444604 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:56.445153 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:56.445156 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:56.445158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:56.446038 (+ 880us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:56.446429 (+ 391us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:56.446855 (+ 426us) server_negotiation.cc:299] Negotiation successful
0812 00:20:56.447396 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":691,"thread_start_us":420,"threads_started":1}
I20260812 00:20:56.456975 22636 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd3acfbae309417aaab42ef052557693" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45645 } }
I20260812 00:20:56.457484 22636 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:20:56.457672 22636 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd3acfbae309417aaab42ef052557693, State: Initialized, Role: FOLLOWER
I20260812 00:20:56.458424 22636 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd3acfbae309417aaab42ef052557693" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45645 } }
I20260812 00:20:56.458727 22636 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:20:56.458900 22636 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:20:56.459095 22636 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:20:56.461721 22636 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd3acfbae309417aaab42ef052557693" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45645 } }
I20260812 00:20:56.462428 22636 leader_election.cc:302] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd3acfbae309417aaab42ef052557693; no voters:
I20260812 00:20:56.463110 22636 leader_election.cc:288] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:20:56.463253 22641 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:20:56.464044 22641 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [term 1 LEADER]: Becoming Leader. State: Replica: dd3acfbae309417aaab42ef052557693, State: Running, Role: LEADER
I20260812 00:20:56.464677 22641 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd3acfbae309417aaab42ef052557693" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45645 } }
I20260812 00:20:56.465500 22636 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:20:56.467687 22642 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd3acfbae309417aaab42ef052557693" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd3acfbae309417aaab42ef052557693" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45645 } } }
I20260812 00:20:56.468040 22642 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [sys.catalog]: This master's current role is: LEADER
I20260812 00:20:56.469125 22643 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd3acfbae309417aaab42ef052557693. Latest consensus state: current_term: 1 leader_uuid: "dd3acfbae309417aaab42ef052557693" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd3acfbae309417aaab42ef052557693" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45645 } } }
I20260812 00:20:56.469563 22643 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693 [sys.catalog]: This master's current role is: LEADER
I20260812 00:20:56.470364 22647 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:20:56.476336 22647 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:20:56.487082 22647 catalog_manager.cc:1347] Generated new cluster ID: d93998d06bbc490a97cea92a41b9112c
I20260812 00:20:56.487226 22647 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:20:56.500938 22647 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:20:56.503142 22647 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:20:56.513558 22647 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd3acfbae309417aaab42ef052557693: Generated new TSK 0
I20260812 00:20:56.514842 22647 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:20:56.585091 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:45645
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:56.958570 22664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:56.958911 22664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:56.959014 22664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:56.967289 22664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:56.967423 22664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:56.967545 22664 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:20:56.978470 22664 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:45645
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:56.979948 22664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:56.981400 22664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:56.995919 22670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:56.995924 22674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:56.996137 22671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:56.997360 22664 server_base.cc:1034] running on GCE node
I20260812 00:20:56.998229 22664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:56.999326 22664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:57.000603 22664 hybrid_clock.cc:648] HybridClock initialized: now 1786494057000547 us; error 51 us; skew 500 ppm
I20260812 00:20:57.000989 22664 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:57 dist-test-slave-njxd krb5kdc[22547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494057, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:57.004742 22664 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:20:57.006496 22664 webserver.cc:460] Webserver started at http://127.18.163.193:37299/ using document root <none> and password file <none>
I20260812 00:20:57.007320 22664 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:57.007486 22664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:57.007831 22664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:57.011210 22664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "9127c59962ff427bb90f1e00a8818925"
format_stamp: "Formatted at 2026-08-12 00:20:57 on dist-test-slave-njxd"
server_key: "4aa3c1c46d760f832921b4f8ba7e9d94"
server_key_iv: "dfee5693eabc3f59102cd2f68e766567"
server_key_version: "encryptionkey@0"
I20260812 00:20:57.012322 22664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "9127c59962ff427bb90f1e00a8818925"
format_stamp: "Formatted at 2026-08-12 00:20:57 on dist-test-slave-njxd"
server_key: "4aa3c1c46d760f832921b4f8ba7e9d94"
server_key_iv: "dfee5693eabc3f59102cd2f68e766567"
server_key_version: "encryptionkey@0"
I20260812 00:20:57.018497 22664 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260812 00:20:57.022754 22682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:57.024461 22664 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:20:57.024693 22664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "9127c59962ff427bb90f1e00a8818925"
format_stamp: "Formatted at 2026-08-12 00:20:57 on dist-test-slave-njxd"
server_key: "4aa3c1c46d760f832921b4f8ba7e9d94"
server_key_iv: "dfee5693eabc3f59102cd2f68e766567"
server_key_version: "encryptionkey@0"
I20260812 00:20:57.024938 22664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:57.051782 22664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:57.056645 22664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:57.057029 22664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:57.058163 22664 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:20:57.059739 22664 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:57.059859 22664 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:57.060026 22664 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:57.060103 22664 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:57.102255 22664 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:35615
I20260812 00:20:57.102305 22808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:35615 every 8 connection(s)
I20260812 00:20:57.103801 22664 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:20:57.113821 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 22664
I20260812 00:20:57.114105 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:20:57.114782 19087 external_mini_cluster.cc:1428] Setting key 6089ebee475c25a9030b9ed29054b7be
Aug 12 00:20:57 dist-test-slave-njxd krb5kdc[22547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494057, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:57.127045 22811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:57.106803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:48717 (local address 127.18.163.254:45645)
0812 00:20:57.107294 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:57.107299 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:57.108423 (+ 1124us) server_negotiation.cc:407] Connection header received
0812 00:20:57.110552 (+ 2129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:57.110559 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:57.110663 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:57.110793 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:57.112522 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:57.113255 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:57.115370 (+ 2115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:57.115816 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:57.115969 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:57.120298 (+ 4329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:57.120304 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:57.120308 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:57.120347 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:57.123207 (+ 2860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:57.124290 (+ 1083us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:57.124300 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:57.124307 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:57.124498 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:57.124998 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:57.125006 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:57.125021 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:57.125461 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:57.125653 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:57.126492 (+ 839us) server_negotiation.cc:299] Negotiation successful
0812 00:20:57.126748 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":223,"threads_started":1}
I20260812 00:20:57.128561 22812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:57.107439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:45645 (local address 127.18.163.193:48717)
0812 00:20:57.108229 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:57.108281 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:57.110233 (+ 1952us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:57.111077 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:57.111086 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:57.111664 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:57.112317 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:57.112336 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:57.113446 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:57.113450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:57.115160 (+ 1710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:57.115176 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:57.116086 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:57.116095 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:57.116380 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:57.117180 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:57.117207 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:57.119988 (+ 2781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:57.123420 (+ 3432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:57.123433 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:57.123460 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:57.124088 (+ 628us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:57.124635 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:57.124639 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:57.124642 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:57.124866 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:57.125659 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:57.125665 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:57.126048 (+ 383us) client_negotiation.cc:769] Sending connection context
0812 00:20:57.126296 (+ 248us) client_negotiation.cc:240] Negotiation successful
0812 00:20:57.126911 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":302,"threads_started":1}
I20260812 00:20:57.130537 22809 heartbeater.cc:347] Connected to a master server at 127.18.163.254:45645
I20260812 00:20:57.130910 22809 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:57.131727 22809 heartbeater.cc:511] Master 127.18.163.254:45645 requested a full tablet report, sending...
I20260812 00:20:57.134083 22598 ts_manager.cc:194] Registered new tserver with Master: 9127c59962ff427bb90f1e00a8818925 (127.18.163.193:35615)
I20260812 00:20:57.136003 22598 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:48717
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:20:57.174595 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:45645
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:57.548308 22815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:57.548722 22815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:57.548919 22815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:57.556814 22815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:57.557037 22815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:57.557243 22815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:20:57.568020 22815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:45645
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:57.569621 22815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:57.571208 22815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:57.586540 22821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:57.586575 22826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:57.586524 22823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:57.587648 22815 server_base.cc:1034] running on GCE node
I20260812 00:20:57.588428 22815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:57.589648 22815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:57.590890 22815 hybrid_clock.cc:648] HybridClock initialized: now 1786494057590843 us; error 48 us; skew 500 ppm
I20260812 00:20:57.591256 22815 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:57 dist-test-slave-njxd krb5kdc[22547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494057, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:57.598174 22815 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:20:57.600090 22815 webserver.cc:460] Webserver started at http://127.18.163.194:37853/ using document root <none> and password file <none>
I20260812 00:20:57.600939 22815 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:57.601119 22815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:57.601482 22815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:57.605053 22815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "898c1dfb3c4b4398bf0a21bafc328341"
format_stamp: "Formatted at 2026-08-12 00:20:57 on dist-test-slave-njxd"
server_key: "7ebc7d7b16a9e0952a8c9077007e3535"
server_key_iv: "0b509251e258764bc6375a3f87a36bfd"
server_key_version: "encryptionkey@0"
I20260812 00:20:57.606093 22815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "898c1dfb3c4b4398bf0a21bafc328341"
format_stamp: "Formatted at 2026-08-12 00:20:57 on dist-test-slave-njxd"
server_key: "7ebc7d7b16a9e0952a8c9077007e3535"
server_key_iv: "0b509251e258764bc6375a3f87a36bfd"
server_key_version: "encryptionkey@0"
I20260812 00:20:57.612488 22815 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:20:57.617020 22834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:57.618809 22815 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:20:57.619055 22815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "898c1dfb3c4b4398bf0a21bafc328341"
format_stamp: "Formatted at 2026-08-12 00:20:57 on dist-test-slave-njxd"
server_key: "7ebc7d7b16a9e0952a8c9077007e3535"
server_key_iv: "0b509251e258764bc6375a3f87a36bfd"
server_key_version: "encryptionkey@0"
I20260812 00:20:57.619318 22815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:57.635515 22815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:57.640215 22815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:57.640584 22815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:57.641764 22815 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:20:57.643314 22815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:57.643426 22815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:57.643585 22815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:57.643664 22815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:57.681296 22815 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:44879
I20260812 00:20:57.681331 22958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:44879 every 8 connection(s)
I20260812 00:20:57.682818 22815 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:20:57.693043 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 22815
I20260812 00:20:57.693302 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:20:57.693836 19087 external_mini_cluster.cc:1428] Setting key 549657513c83cabf00a6ba5d2a541f1f
Aug 12 00:20:57 dist-test-slave-njxd krb5kdc[22547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494057, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:57.706368 22961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:57.685732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:38917 (local address 127.18.163.254:45645)
0812 00:20:57.686218 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:57.686223 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:57.687212 (+ 989us) server_negotiation.cc:407] Connection header received
0812 00:20:57.689224 (+ 2012us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:57.689230 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:57.689333 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:57.689465 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:57.691288 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:57.692019 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:57.693947 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:57.694426 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:57.694589 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:57.699650 (+ 5061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:57.699655 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:57.699659 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:57.699699 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:57.702567 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:57.703704 (+ 1137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:57.703708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:57.703711 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:57.703852 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:57.704415 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:57.704418 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:57.704420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:57.704698 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:57.704890 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:57.705704 (+ 814us) server_negotiation.cc:299] Negotiation successful
0812 00:20:57.705954 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":256,"threads_started":1}
I20260812 00:20:57.707454 22962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:57.686225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:45645 (local address 127.18.163.194:38917)
0812 00:20:57.687020 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:57.687069 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:57.688886 (+ 1817us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:57.689778 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:57.689787 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:57.690398 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:57.691053 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:57.691073 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:57.692213 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:57.692217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:57.693775 (+ 1558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:57.693790 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:57.694724 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:57.694731 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:57.695071 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:57.695898 (+ 827us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:57.695932 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:57.699298 (+ 3366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:57.702776 (+ 3478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:57.702790 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:57.702814 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:57.703559 (+ 745us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:57.703970 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:57.703977 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:57.703983 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:57.704293 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:57.704868 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:57.704878 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:57.705280 (+ 402us) client_negotiation.cc:769] Sending connection context
0812 00:20:57.705567 (+ 287us) client_negotiation.cc:240] Negotiation successful
0812 00:20:57.706198 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":297,"threads_started":1}
I20260812 00:20:57.709125 22959 heartbeater.cc:347] Connected to a master server at 127.18.163.254:45645
I20260812 00:20:57.709478 22959 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:57.710305 22959 heartbeater.cc:511] Master 127.18.163.254:45645 requested a full tablet report, sending...
I20260812 00:20:57.711959 22598 ts_manager.cc:194] Registered new tserver with Master: 898c1dfb3c4b4398bf0a21bafc328341 (127.18.163.194:44879)
I20260812 00:20:57.712847 22598 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:38917
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
I20260812 00:20:57.753461 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:45645
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:20:58.123194 22965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:20:58.123522 22965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:20:58.123769 22965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:20:58.131882 22965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:20:58.132015 22965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:20:58.132265 22965 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:20:58.139607 22809 heartbeater.cc:503] Master 127.18.163.254:45645 was elected leader, sending a full tablet report...
I20260812 00:20:58.143469 22965 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:45645
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:20:58.144955 22965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:20:58.146461 22965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:20:58.161228 22972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:58.161306 22974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:20:58.161283 22977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:20:58.162631 22965 server_base.cc:1034] running on GCE node
I20260812 00:20:58.163371 22965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:20:58.164500 22965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:20:58.165740 22965 hybrid_clock.cc:648] HybridClock initialized: now 1786494058165685 us; error 49 us; skew 500 ppm
I20260812 00:20:58.166215 22965 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:20:58 dist-test-slave-njxd krb5kdc[22547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494058, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:20:58.169834 22965 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:20:58.171619 22965 webserver.cc:460] Webserver started at http://127.18.163.195:39225/ using document root <none> and password file <none>
I20260812 00:20:58.172441 22965 fs_manager.cc:359] Metadata directory not provided
I20260812 00:20:58.172639 22965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:20:58.172986 22965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:20:58.176312 22965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "80e940d5dde64137a0ee09ed2f7d56f0"
format_stamp: "Formatted at 2026-08-12 00:20:58 on dist-test-slave-njxd"
server_key: "11479fd45f70b2e03655790fb9ef7cb7"
server_key_iv: "997b3c33c1c150145fc8c57646852b84"
server_key_version: "encryptionkey@0"
I20260812 00:20:58.177232 22965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "80e940d5dde64137a0ee09ed2f7d56f0"
format_stamp: "Formatted at 2026-08-12 00:20:58 on dist-test-slave-njxd"
server_key: "11479fd45f70b2e03655790fb9ef7cb7"
server_key_iv: "997b3c33c1c150145fc8c57646852b84"
server_key_version: "encryptionkey@0"
I20260812 00:20:58.183321 22965 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.003s
I20260812 00:20:58.187633 22984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:58.189236 22965 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:20:58.189443 22965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "80e940d5dde64137a0ee09ed2f7d56f0"
format_stamp: "Formatted at 2026-08-12 00:20:58 on dist-test-slave-njxd"
server_key: "11479fd45f70b2e03655790fb9ef7cb7"
server_key_iv: "997b3c33c1c150145fc8c57646852b84"
server_key_version: "encryptionkey@0"
I20260812 00:20:58.189759 22965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:20:58.203738 22965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:20:58.208724 22965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:20:58.209089 22965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:20:58.210289 22965 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:20:58.211956 22965 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:20:58.212069 22965 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:58.212244 22965 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:20:58.212321 22965 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:20:58.249662 22965 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:38415
I20260812 00:20:58.249738 23112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:38415 every 8 connection(s)
I20260812 00:20:58.251216 22965 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:20:58.252363 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 22965
I20260812 00:20:58.252616 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:20:58.253171 19087 external_mini_cluster.cc:1428] Setting key 3b6db5fe755a98ca1c7f532593c5569d
Aug 12 00:20:58 dist-test-slave-njxd krb5kdc[22547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494058, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:58.275369 23115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:58.254365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:36129 (local address 127.18.163.254:45645)
0812 00:20:58.254946 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:58.254952 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:58.256494 (+ 1542us) server_negotiation.cc:407] Connection header received
0812 00:20:58.258649 (+ 2155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:58.258654 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:58.258745 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:58.258845 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:58.260549 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:58.261439 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:58.263386 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:58.263812 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:58.263917 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:58.268265 (+ 4348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:58.268270 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:58.268273 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:58.268339 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:58.271725 (+ 3386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:58.272630 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:58.272634 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:58.272637 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:58.272811 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:58.273272 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:58.273277 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:58.273284 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:58.273641 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:58.273779 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:58.274609 (+ 830us) server_negotiation.cc:299] Negotiation successful
0812 00:20:58.274845 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":295,"threads_started":1}
I20260812 00:20:58.276684 23117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:58.255232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:45645 (local address 127.18.163.195:36129)
0812 00:20:58.256285 (+ 1053us) negotiation.cc:107] Waiting for socket to connect
0812 00:20:58.256356 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0812 00:20:58.258352 (+ 1996us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:20:58.259096 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:20:58.259106 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:20:58.259705 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:20:58.260368 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:58.260388 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:58.261722 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:58.261727 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:58.263211 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:20:58.263232 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:20:58.264031 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:20:58.264036 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:20:58.264268 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:58.265077 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:20:58.265103 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:20:58.268012 (+ 2909us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:20:58.271920 (+ 3908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:58.271929 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:58.271945 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:58.272500 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:58.272917 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:20:58.272920 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:20:58.272922 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:20:58.273145 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:20:58.273786 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:20:58.273794 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:20:58.274195 (+ 401us) client_negotiation.cc:769] Sending connection context
0812 00:20:58.274488 (+ 293us) client_negotiation.cc:240] Negotiation successful
0812 00:20:58.275180 (+ 692us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":710,"thread_start_us":381,"threads_started":1}
I20260812 00:20:58.278437 23113 heartbeater.cc:347] Connected to a master server at 127.18.163.254:45645
I20260812 00:20:58.278816 23113 heartbeater.cc:464] Registering TS with master...
I20260812 00:20:58.279692 23113 heartbeater.cc:511] Master 127.18.163.254:45645 requested a full tablet report, sending...
I20260812 00:20:58.281548 22598 ts_manager.cc:194] Registered new tserver with Master: 80e940d5dde64137a0ee09ed2f7d56f0 (127.18.163.195:38415)
I20260812 00:20:58.282805 22598 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:36129
I20260812 00:20:58.283085 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:20:58 dist-test-slave-njxd krb5kdc[22547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494058, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 00:20:58 dist-test-slave-njxd krb5kdc[22547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494058, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:20:58.349677 23115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:58.334534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41480 (local address 127.18.163.254:45645)
0812 00:20:58.334801 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:58.334811 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:58.335277 (+ 466us) server_negotiation.cc:407] Connection header received
0812 00:20:58.335529 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:58.335534 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:58.335614 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:58.335739 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:58.337241 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:58.338163 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:58.339506 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:58.339930 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:58.340082 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:58.344306 (+ 4224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:58.344312 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:58.344315 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:58.344358 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:58.347213 (+ 2855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:58.347875 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:58.347879 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:58.347881 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:58.348016 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:58.348364 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:58.348367 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:58.348369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:58.348712 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:58.348908 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:58.349159 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 00:20:58.349348 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260812 00:20:58.350257 22598 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41480
I20260812 00:20:58.352339 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 22664
Aug 12 00:20:58 dist-test-slave-njxd krb5kdc[22547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494058, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:20:58.370206 23127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:58.353555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59548 (local address 127.18.163.193:35615)
0812 00:20:58.354285 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:58.354292 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:58.354319 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:20:58.354377 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:58.354383 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:58.354627 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:58.354756 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:58.356018 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:58.357157 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:58.358493 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:58.359120 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:58.359229 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:58.363777 (+ 4548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:58.363795 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:58.363813 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:58.363864 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:58.367161 (+ 3297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:58.367958 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:58.367965 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:58.367968 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:58.368128 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:58.368500 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:58.368503 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:58.368505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:58.368885 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:58.369139 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:58.369411 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 00:20:58.369734 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":356,"threads_started":1}
W20260812 00:20:58.371605 22804 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:59548
W20260812 00:20:58.373015 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 22664: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:20:58.373307 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 22664
I20260812 00:20:58.398990 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 22815
Aug 12 00:20:58 dist-test-slave-njxd krb5kdc[22547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494058, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
I20260812 00:20:58.416414 23128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:58.399923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59006 (local address 127.18.163.194:44879)
0812 00:20:58.400523 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:58.400531 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:58.400571 (+ 40us) server_negotiation.cc:407] Connection header received
0812 00:20:58.400636 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:58.400643 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:58.400893 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:58.401076 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:58.402540 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:58.403627 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:58.404919 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:58.405515 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:58.405793 (+ 278us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:58.410314 (+ 4521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:58.410330 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:58.410346 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:58.410385 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:58.413246 (+ 2861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:58.414072 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:58.414089 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:58.414091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:58.414225 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:58.414655 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:58.414662 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:58.414670 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:58.415041 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:58.415444 (+ 403us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:58.415749 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 00:20:58.416050 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":305,"threads_started":1}
W20260812 00:20:58.417959 22954 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:59006
W20260812 00:20:58.419356 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 22815: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:20:58.419559 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 22815
I20260812 00:20:58.441521 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 22965
Aug 12 00:20:58 dist-test-slave-njxd krb5kdc[22547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494058, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:20:58.460059 23129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:20:58.442741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44860 (local address 127.18.163.195:38415)
0812 00:20:58.443436 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0812 00:20:58.443443 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:20:58.443475 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:20:58.443542 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:20:58.443548 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:20:58.443782 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:20:58.443969 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:20:58.445460 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:58.446770 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:58.448081 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:20:58.448704 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:20:58.448881 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:20:58.453742 (+ 4861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:20:58.453764 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:20:58.453790 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:20:58.453836 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:20:58.456728 (+ 2892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:58.457664 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:58.457672 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:58.457675 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:58.457818 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:20:58.458267 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:20:58.458271 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:20:58.458273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:20:58.458669 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:20:58.459014 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0812 00:20:58.459355 (+ 341us) server_negotiation.cc:299] Negotiation successful
0812 00:20:58.459664 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":367,"threads_started":1}
W20260812 00:20:58.461707 23108 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:44860
W20260812 00:20:58.463003 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 22965: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:20:58.463188 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 22965
I20260812 00:20:58.485566 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 22561
I20260812 00:20:58.486853 22630 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:20:58.598562 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 22561
2026-08-12T00:20:58Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4108 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:20:58 dist-test-slave-njxd krb5kdc[23134](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:20:58 dist-test-slave-njxd krb5kdc[23134](info): set up 2 sockets
Aug 12 00:20:58 dist-test-slave-njxd krb5kdc[23134](info): commencing operation
krb5kdc: starting...
W20260812 00:20:59.805312 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.001s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:20:59 dist-test-slave-njxd krb5kdc[23134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:21:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:21:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:21:00.075376 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:34445
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:37131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:34445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:00.445736 23151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:00.446137 23151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:00.446312 23151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:00.454265 23151 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:21:00.454398 23151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:00.454510 23151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:00.454629 23151 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:21:00.454720 23151 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:21:00.466171 23151 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:37131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:34445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:34445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:00.467700 23151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:00.469161 23151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:00.482048 23156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:00.481961 23157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:00.482002 23160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:00.483464 23151 server_base.cc:1034] running on GCE node
I20260812 00:21:00.484431 23151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:00.486099 23151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:00.487334 23151 hybrid_clock.cc:648] HybridClock initialized: now 1786494060487268 us; error 66 us; skew 500 ppm
I20260812 00:21:00.487673 23151 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:00 dist-test-slave-njxd krb5kdc[23134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494060, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:00.491279 23151 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:21:00.493156 23151 webserver.cc:460] Webserver started at http://127.18.163.254:33773/ using document root <none> and password file <none>
I20260812 00:21:00.494057 23151 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:00.494215 23151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:00.494616 23151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:00.498122 23151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "63a5f5ad685d435ea833c51e2daef255"
format_stamp: "Formatted at 2026-08-12 00:21:00 on dist-test-slave-njxd"
server_key: "30aa10d5ed91a73b15a728328ff4082f"
server_key_iv: "281d48206d1e0befeaed62fb7a24a21b"
server_key_version: "encryptionkey@0"
I20260812 00:21:00.499013 23151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "63a5f5ad685d435ea833c51e2daef255"
format_stamp: "Formatted at 2026-08-12 00:21:00 on dist-test-slave-njxd"
server_key: "30aa10d5ed91a73b15a728328ff4082f"
server_key_iv: "281d48206d1e0befeaed62fb7a24a21b"
server_key_version: "encryptionkey@0"
I20260812 00:21:00.504864 23151 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260812 00:21:00.508749 23168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:00.510426 23151 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:21:00.510667 23151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "63a5f5ad685d435ea833c51e2daef255"
format_stamp: "Formatted at 2026-08-12 00:21:00 on dist-test-slave-njxd"
server_key: "30aa10d5ed91a73b15a728328ff4082f"
server_key_iv: "281d48206d1e0befeaed62fb7a24a21b"
server_key_version: "encryptionkey@0"
I20260812 00:21:00.510905 23151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:00.529958 23151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:00.534657 23151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:00.535007 23151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:00.557353 23151 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:34445
I20260812 00:21:00.557374 23222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:34445 every 8 connection(s)
I20260812 00:21:00.558919 23151 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:21:00.563004 23223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:00.564486 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 23151
I20260812 00:21:00.564719 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:21:00.565611 19087 external_mini_cluster.cc:1428] Setting key 1a803affc7bb8d113f8d0218a5de2205
I20260812 00:21:00.579217 23223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255: Bootstrap starting.
Aug 12 00:21:00 dist-test-slave-njxd krb5kdc[23134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:21:00.583352 23223 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:00.584947 23223 log.cc:824] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:00.588347 23223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255: No bootstrap required, opened a new log
I20260812 00:21:00.591708 23226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:00.567887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46560 (local address 127.18.163.254:34445)
0812 00:21:00.568819 (+ 932us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:00.568832 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:00.568877 (+ 45us) server_negotiation.cc:407] Connection header received
0812 00:21:00.570706 (+ 1829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:00.570738 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:00.571210 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:00.571604 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:00.573701 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:00.575101 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:00.577122 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:00.577988 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:00.578148 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:00.583062 (+ 4914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:00.583072 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:00.583089 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:00.583134 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:00.587024 (+ 3890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:00.587883 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:00.587891 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:00.587898 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:00.588092 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:00.588522 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:00.588530 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:00.588533 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:00.589152 (+ 619us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:00.589514 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:00.590025 (+ 511us) server_negotiation.cc:299] Negotiation successful
0812 00:21:00.590541 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":686,"thread_start_us":442,"threads_started":1}
I20260812 00:21:00.597301 23223 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63a5f5ad685d435ea833c51e2daef255" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34445 } }
I20260812 00:21:00.597894 23223 raft_consensus.cc:374] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:00.598028 23223 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63a5f5ad685d435ea833c51e2daef255, State: Initialized, Role: FOLLOWER
I20260812 00:21:00.598819 23223 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63a5f5ad685d435ea833c51e2daef255" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34445 } }
I20260812 00:21:00.599153 23223 raft_consensus.cc:388] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:21:00.599336 23223 raft_consensus.cc:482] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:21:00.599534 23223 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:00.602322 23223 raft_consensus.cc:504] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63a5f5ad685d435ea833c51e2daef255" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34445 } }
I20260812 00:21:00.602981 23223 leader_election.cc:302] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63a5f5ad685d435ea833c51e2daef255; no voters:
I20260812 00:21:00.603679 23223 leader_election.cc:288] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:21:00.603835 23228 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:00.604719 23228 raft_consensus.cc:686] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [term 1 LEADER]: Becoming Leader. State: Replica: 63a5f5ad685d435ea833c51e2daef255, State: Running, Role: LEADER
I20260812 00:21:00.605376 23228 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63a5f5ad685d435ea833c51e2daef255" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34445 } }
I20260812 00:21:00.606221 23223 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:21:00.608886 23230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63a5f5ad685d435ea833c51e2daef255. Latest consensus state: current_term: 1 leader_uuid: "63a5f5ad685d435ea833c51e2daef255" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63a5f5ad685d435ea833c51e2daef255" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34445 } } }
I20260812 00:21:00.609082 23229 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "63a5f5ad685d435ea833c51e2daef255" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63a5f5ad685d435ea833c51e2daef255" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34445 } } }
I20260812 00:21:00.609411 23229 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:00.609411 23230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:00.611867 23239 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:21:00.617239 23239 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:21:00.627065 23239 catalog_manager.cc:1347] Generated new cluster ID: 287b46c2af374a4796dbc0e5e0818cce
I20260812 00:21:00.627250 23239 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:21:00.636049 23239 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:21:00.638159 23239 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:21:00.648331 23239 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 63a5f5ad685d435ea833c51e2daef255: Generated new TSK 0
I20260812 00:21:00.649633 23239 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:21:00.714144 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34445
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:37131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:01.091266 23253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:01.091583 23253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:01.091684 23253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:01.099516 23253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:01.099660 23253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:01.099781 23253 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:21:01.110841 23253 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:37131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34445
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:01.112393 23253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:01.113974 23253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:01.129352 23259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:01.129421 23260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:01.129325 23262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:01.130784 23253 server_base.cc:1034] running on GCE node
I20260812 00:21:01.131557 23253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:01.132674 23253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:01.133935 23253 hybrid_clock.cc:648] HybridClock initialized: now 1786494061133874 us; error 53 us; skew 500 ppm
I20260812 00:21:01.134305 23253 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:01 dist-test-slave-njxd krb5kdc[23134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494061, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:01.137943 23253 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:21:01.139662 23253 webserver.cc:460] Webserver started at http://127.18.163.193:37979/ using document root <none> and password file <none>
I20260812 00:21:01.140468 23253 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:01.140635 23253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:01.140988 23253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:01.144373 23253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "b311c5ab170b45f0a04a3849a63acfd2"
format_stamp: "Formatted at 2026-08-12 00:21:01 on dist-test-slave-njxd"
server_key: "5cf0aa04a1601a7d87348a57d7284b32"
server_key_iv: "9248eae56505668b801fa5d90e0e60ab"
server_key_version: "encryptionkey@0"
I20260812 00:21:01.145239 23253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "b311c5ab170b45f0a04a3849a63acfd2"
format_stamp: "Formatted at 2026-08-12 00:21:01 on dist-test-slave-njxd"
server_key: "5cf0aa04a1601a7d87348a57d7284b32"
server_key_iv: "9248eae56505668b801fa5d90e0e60ab"
server_key_version: "encryptionkey@0"
I20260812 00:21:01.151659 23253 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s
I20260812 00:21:01.155674 23269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:01.157311 23253 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:21:01.157478 23253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "b311c5ab170b45f0a04a3849a63acfd2"
format_stamp: "Formatted at 2026-08-12 00:21:01 on dist-test-slave-njxd"
server_key: "5cf0aa04a1601a7d87348a57d7284b32"
server_key_iv: "9248eae56505668b801fa5d90e0e60ab"
server_key_version: "encryptionkey@0"
I20260812 00:21:01.157778 23253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:01.185174 23253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:01.190397 23253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:01.190677 23253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:01.191704 23253 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:01.193243 23253 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:01.193326 23253 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:01.193418 23253 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:01.193465 23253 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:01.230333 23253 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:35223
I20260812 00:21:01.230392 23393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:35223 every 8 connection(s)
I20260812 00:21:01.232144 23253 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:21:01.233318 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 23253
I20260812 00:21:01.233537 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:21:01.234301 19087 external_mini_cluster.cc:1428] Setting key 76da802e8b4a3057ad1ea07dfd026118
Aug 12 00:21:01 dist-test-slave-njxd krb5kdc[23134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494061, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:21:01.255760 23396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:01.235163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:52449 (local address 127.18.163.254:34445)
0812 00:21:01.235734 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:01.235741 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:01.237032 (+ 1291us) server_negotiation.cc:407] Connection header received
0812 00:21:01.239150 (+ 2118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:01.239156 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:01.239260 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:01.239390 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:01.241631 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:01.242392 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:01.244062 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:01.244494 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:01.244645 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:01.248994 (+ 4349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:01.248999 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:01.249003 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:01.249041 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:01.251894 (+ 2853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:01.253043 (+ 1149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:01.253048 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:01.253050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:01.253186 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:01.253794 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:01.253798 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:01.253800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:01.254083 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:01.254208 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:01.255256 (+ 1048us) server_negotiation.cc:299] Negotiation successful
0812 00:21:01.255464 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":285,"threads_started":1}
I20260812 00:21:01.257637 23397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:01.235927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34445 (local address 127.18.163.193:52449)
0812 00:21:01.236858 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:01.236906 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:01.238816 (+ 1910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:01.239657 (+ 841us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:01.239667 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:01.240542 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:01.241407 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:01.241428 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:01.242582 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:01.242586 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:01.243900 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:01.243913 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:01.244754 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:01.244764 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:01.245025 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:01.245835 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:01.245859 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:01.248702 (+ 2843us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:01.252097 (+ 3395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:01.252112 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:01.252136 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:01.252904 (+ 768us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:01.253310 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:01.253318 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:01.253324 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:01.253660 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:01.254239 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:01.254250 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:01.254805 (+ 555us) client_negotiation.cc:769] Sending connection context
0812 00:21:01.255148 (+ 343us) client_negotiation.cc:240] Negotiation successful
0812 00:21:01.255894 (+ 746us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":407,"threads_started":1}
I20260812 00:21:01.259526 23394 heartbeater.cc:347] Connected to a master server at 127.18.163.254:34445
I20260812 00:21:01.259877 23394 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:01.260690 23394 heartbeater.cc:511] Master 127.18.163.254:34445 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
I20260812 00:21:01.263430 23186 ts_manager.cc:194] Registered new tserver with Master: b311c5ab170b45f0a04a3849a63acfd2 (127.18.163.193:35223)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
I20260812 00:21:01.265316 23186 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:52449
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:21:01.296288 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34445
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:37131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:01.668901 23400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:01.669260 23400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:01.669368 23400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:01.678064 23400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:01.678221 23400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:01.678349 23400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:21:01.689328 23400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:37131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34445
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:01.690843 23400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:01.692260 23400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:01.707360 23407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:01.707429 23410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:01.707980 23408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:01.708459 23400 server_base.cc:1034] running on GCE node
I20260812 00:21:01.709163 23400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:01.710384 23400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:01.711618 23400 hybrid_clock.cc:648] HybridClock initialized: now 1786494061711542 us; error 80 us; skew 500 ppm
I20260812 00:21:01.712020 23400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:01 dist-test-slave-njxd krb5kdc[23134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494061, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:01.715782 23400 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:21:01.717514 23400 webserver.cc:460] Webserver started at http://127.18.163.194:34225/ using document root <none> and password file <none>
I20260812 00:21:01.718443 23400 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:01.718593 23400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:01.718955 23400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:01.722389 23400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "02a38d89122941a2a42b31fa71222288"
format_stamp: "Formatted at 2026-08-12 00:21:01 on dist-test-slave-njxd"
server_key: "cc63a951f9ae1984ba15b099258724a4"
server_key_iv: "83368c9f7cb8790307e4e49d99598d36"
server_key_version: "encryptionkey@0"
I20260812 00:21:01.723414 23400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "02a38d89122941a2a42b31fa71222288"
format_stamp: "Formatted at 2026-08-12 00:21:01 on dist-test-slave-njxd"
server_key: "cc63a951f9ae1984ba15b099258724a4"
server_key_iv: "83368c9f7cb8790307e4e49d99598d36"
server_key_version: "encryptionkey@0"
I20260812 00:21:01.729923 23400 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 00:21:01.734360 23419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:01.736050 23400 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 00:21:01.736297 23400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "02a38d89122941a2a42b31fa71222288"
format_stamp: "Formatted at 2026-08-12 00:21:01 on dist-test-slave-njxd"
server_key: "cc63a951f9ae1984ba15b099258724a4"
server_key_iv: "83368c9f7cb8790307e4e49d99598d36"
server_key_version: "encryptionkey@0"
I20260812 00:21:01.736552 23400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:01.753813 23400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:01.758733 23400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:01.759086 23400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:01.760214 23400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:01.761842 23400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:01.762054 23400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:01.762212 23400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:01.762291 23400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:01.799129 23400 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:33747
I20260812 00:21:01.799180 23547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:33747 every 8 connection(s)
I20260812 00:21:01.800632 23400 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:21:01.805843 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 23400
I20260812 00:21:01.806021 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:21:01.806527 19087 external_mini_cluster.cc:1428] Setting key e649837bd38433ae903f9ab30fad0e8e
Aug 12 00:21:01 dist-test-slave-njxd krb5kdc[23134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494061, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:21:01.825127 23550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:01.803520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:55179 (local address 127.18.163.254:34445)
0812 00:21:01.804023 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:01.804028 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:01.804989 (+ 961us) server_negotiation.cc:407] Connection header received
0812 00:21:01.807263 (+ 2274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:01.807268 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:01.807424 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:01.807557 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:01.809730 (+ 2173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:01.811023 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:01.812723 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:01.813500 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:01.813703 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:01.818102 (+ 4399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:01.818112 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:01.818119 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:01.818179 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:01.821244 (+ 3065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:01.822406 (+ 1162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:01.822410 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:01.822413 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:01.822559 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:01.823141 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:01.823148 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:01.823150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:01.823458 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:01.823582 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:01.824629 (+ 1047us) server_negotiation.cc:299] Negotiation successful
0812 00:21:01.824839 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":271,"threads_started":1}
I20260812 00:21:01.826963 23551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:01.804001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34445 (local address 127.18.163.194:55179)
0812 00:21:01.804790 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:01.804839 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:01.806932 (+ 2093us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:01.807877 (+ 945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:01.807890 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:01.808747 (+ 857us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:01.809464 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:01.809483 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:01.811192 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:01.811197 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:01.812542 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:01.812557 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:01.813816 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:01.813821 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:01.814123 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:01.814973 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:01.814999 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:01.817798 (+ 2799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:01.821450 (+ 3652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:01.821464 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:01.821487 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:01.822266 (+ 779us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:01.822685 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:01.822692 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:01.822698 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:01.823005 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:01.823625 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:01.823637 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:01.824185 (+ 548us) client_negotiation.cc:769] Sending connection context
0812 00:21:01.824528 (+ 343us) client_negotiation.cc:240] Negotiation successful
0812 00:21:01.825198 (+ 670us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":312,"threads_started":1}
I20260812 00:21:01.828711 23548 heartbeater.cc:347] Connected to a master server at 127.18.163.254:34445
I20260812 00:21:01.829087 23548 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:01.829995 23548 heartbeater.cc:511] Master 127.18.163.254:34445 requested a full tablet report, sending...
I20260812 00:21:01.831794 23186 ts_manager.cc:194] Registered new tserver with Master: 02a38d89122941a2a42b31fa71222288 (127.18.163.194:33747)
I20260812 00:21:01.832692 23186 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:55179
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
I20260812 00:21:01.867048 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34445
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:37131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:02.244176 23555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:02.244685 23555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:02.244897 23555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:02.254774 23555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:02.254961 23555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:02.255177 23555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:21:02.266469 23555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:37131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34445
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:02.268026 23555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:02.268846 23394 heartbeater.cc:503] Master 127.18.163.254:34445 was elected leader, sending a full tablet report...
I20260812 00:21:02.269840 23555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:02.290742 23561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:02.290635 23560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:02.290706 23563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:02.292171 23555 server_base.cc:1034] running on GCE node
I20260812 00:21:02.292922 23555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:02.294183 23555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:02.295452 23555 hybrid_clock.cc:648] HybridClock initialized: now 1786494062295397 us; error 49 us; skew 500 ppm
I20260812 00:21:02.295837 23555 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:02 dist-test-slave-njxd krb5kdc[23134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494062, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:02.299475 23555 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:21:02.301183 23555 webserver.cc:460] Webserver started at http://127.18.163.195:34545/ using document root <none> and password file <none>
I20260812 00:21:02.302083 23555 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:02.302254 23555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:02.302698 23555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:02.306079 23555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "67c0b5922e0c4819adb130ff5e7d3386"
format_stamp: "Formatted at 2026-08-12 00:21:02 on dist-test-slave-njxd"
server_key: "b925125487360dbad290597574cf3057"
server_key_iv: "b4b59b268644d2a303e8e2c686deadf2"
server_key_version: "encryptionkey@0"
I20260812 00:21:02.307009 23555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "67c0b5922e0c4819adb130ff5e7d3386"
format_stamp: "Formatted at 2026-08-12 00:21:02 on dist-test-slave-njxd"
server_key: "b925125487360dbad290597574cf3057"
server_key_iv: "b4b59b268644d2a303e8e2c686deadf2"
server_key_version: "encryptionkey@0"
I20260812 00:21:02.313150 23555 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:21:02.317760 23571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:02.319365 23555 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:21:02.319582 23555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "67c0b5922e0c4819adb130ff5e7d3386"
format_stamp: "Formatted at 2026-08-12 00:21:02 on dist-test-slave-njxd"
server_key: "b925125487360dbad290597574cf3057"
server_key_iv: "b4b59b268644d2a303e8e2c686deadf2"
server_key_version: "encryptionkey@0"
I20260812 00:21:02.319887 23555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:02.335543 23555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:02.340235 23555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:02.340584 23555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:02.341868 23555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:02.343411 23555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:02.343524 23555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:02.343696 23555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:02.343772 23555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:02.379865 23555 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:44407
I20260812 00:21:02.379913 23698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:44407 every 8 connection(s)
I20260812 00:21:02.381378 23555 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:21:02.386482 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 23555
I20260812 00:21:02.386690 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:21:02.387283 19087 external_mini_cluster.cc:1428] Setting key 930f387ead1c2790f8ba735f5ee51a7d
Aug 12 00:21:02 dist-test-slave-njxd krb5kdc[23134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494062, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:21:02.404814 23701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:02.384222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:34091 (local address 127.18.163.254:34445)
0812 00:21:02.384791 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:02.384798 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:02.385918 (+ 1120us) server_negotiation.cc:407] Connection header received
0812 00:21:02.388752 (+ 2834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:02.388758 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:02.388854 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:02.388976 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:02.391005 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:02.391845 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:02.393541 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:02.394031 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:02.394190 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:02.398272 (+ 4082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:02.398278 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:02.398281 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:02.398323 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:02.401114 (+ 2791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:02.402115 (+ 1001us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:02.402121 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:02.402135 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:02.402279 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:02.402791 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:02.402803 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:02.402806 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:02.403122 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:02.403317 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:02.404137 (+ 820us) server_negotiation.cc:299] Negotiation successful
0812 00:21:02.404402 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":260,"threads_started":1}
I20260812 00:21:02.406002 23702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:02.384834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34445 (local address 127.18.163.195:34091)
0812 00:21:02.385730 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:02.385784 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:02.388218 (+ 2434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:02.389277 (+ 1059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:02.389287 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:02.390139 (+ 852us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:02.390807 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:02.390829 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:02.392032 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:02.392037 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:02.393367 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:02.393381 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:02.394325 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:02.394334 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:02.394602 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:02.395402 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:02.395433 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:02.397966 (+ 2533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:02.401323 (+ 3357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:02.401334 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:02.401362 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:02.401954 (+ 592us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:02.402408 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:02.402413 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:02.402416 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:02.402654 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:02.403285 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:02.403294 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:02.403717 (+ 423us) client_negotiation.cc:769] Sending connection context
0812 00:21:02.404022 (+ 305us) client_negotiation.cc:240] Negotiation successful
0812 00:21:02.404643 (+ 621us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":328,"threads_started":1}
I20260812 00:21:02.407656 23699 heartbeater.cc:347] Connected to a master server at 127.18.163.254:34445
I20260812 00:21:02.408016 23699 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:02.408787 23699 heartbeater.cc:511] Master 127.18.163.254:34445 requested a full tablet report, sending...
I20260812 00:21:02.410444 23186 ts_manager.cc:194] Registered new tserver with Master: 67c0b5922e0c4819adb130ff5e7d3386 (127.18.163.195:44407)
I20260812 00:21:02.411302 23186 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:34091
I20260812 00:21:02.416189 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:21:02 dist-test-slave-njxd krb5kdc[23134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:21:02 dist-test-slave-njxd krb5kdc[23134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:21:02.479557 23708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:02.463829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36042 (local address 127.18.163.193:35223)
0812 00:21:02.464527 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:02.464534 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:02.464564 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:21:02.464645 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:02.464652 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:02.464870 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:02.465024 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:02.466564 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:02.467634 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:02.468881 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:02.469452 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:02.469551 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:02.473789 (+ 4238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:02.473806 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:02.473822 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:02.473867 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:02.476703 (+ 2836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:02.477410 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:02.477417 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:02.477420 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:02.477556 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:02.478012 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:02.478019 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:02.478024 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:02.478540 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:02.478870 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:02.479046 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 00:21:02.479260 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":382,"threads_started":1}
Aug 12 00:21:02 dist-test-slave-njxd krb5kdc[23134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:21:02.499208 23701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:02.484507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37942 (local address 127.18.163.254:34445)
0812 00:21:02.484746 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:02.484752 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:02.484995 (+ 243us) server_negotiation.cc:407] Connection header received
0812 00:21:02.485210 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:02.485215 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:02.485290 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:02.485399 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:02.486842 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:02.487613 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:02.488892 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:02.489306 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:02.489448 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:02.493655 (+ 4207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:02.493664 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:02.493673 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:02.493714 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:02.496274 (+ 2560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:02.497019 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:02.497025 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:02.497029 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:02.497170 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:02.497570 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:02.497602 (+ 32us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:02.497607 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:02.497977 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:02.498249 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:02.498596 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 00:21:02.498858 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260812 00:21:02.499943 23186 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37942
I20260812 00:21:02.501255 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 23253
I20260812 00:21:02.515154 23708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:02.502327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36054 (local address 127.18.163.193:35223)
0812 00:21:02.502545 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:02.502551 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:02.502736 (+ 185us) server_negotiation.cc:407] Connection header received
0812 00:21:02.502862 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:02.502866 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:02.502958 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:02.503041 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:02.504283 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:02.504976 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:02.506447 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:02.506901 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:02.507010 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:02.509748 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:02.509753 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:02.509757 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:02.509807 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:02.512498 (+ 2691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:02.513216 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:02.513221 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:02.513224 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:02.513366 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:02.513777 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:02.513780 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:02.513782 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:02.514041 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:02.514228 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:02.514551 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 00:21:02.514810 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260812 00:21:02.515906 23389 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:02.605051 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 23253
I20260812 00:21:02.629057 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 23400
Aug 12 00:21:02 dist-test-slave-njxd krb5kdc[23134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
I20260812 00:21:02.650019 23713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:02.630097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34042 (local address 127.18.163.194:33747)
0812 00:21:02.630685 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:02.630692 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:02.630719 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:21:02.630785 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:02.630792 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:02.631025 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:02.631168 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:02.632398 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:02.633406 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:02.634696 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:02.635269 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:02.635371 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:02.643960 (+ 8589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:02.643975 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:02.643991 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:02.644033 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:02.647141 (+ 3108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:02.647927 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:02.647935 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:02.647937 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:02.648077 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:02.648445 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:02.648448 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:02.648450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:02.648834 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:02.649087 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:02.649330 (+ 243us) server_negotiation.cc:299] Negotiation successful
0812 00:21:02.649555 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":310,"threads_started":1}
I20260812 00:21:02.651410 23542 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:02.738400 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 23400
I20260812 00:21:02.762244 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 23555
Aug 12 00:21:02 dist-test-slave-njxd krb5kdc[23134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:21:02.780232 23715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:02.763436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34140 (local address 127.18.163.195:44407)
0812 00:21:02.764183 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:02.764190 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:02.764221 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:21:02.764289 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:02.764296 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:02.764513 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:02.764666 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:02.766071 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:02.767143 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:02.768530 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:02.769162 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:02.769285 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:02.773986 (+ 4701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:02.774003 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:02.774021 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:02.774073 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:02.777227 (+ 3154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:02.778124 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:02.778131 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:02.778134 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:02.778271 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:02.778628 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:02.778631 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:02.778633 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:02.779027 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:02.779285 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:02.779554 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 00:21:02.779793 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":410,"threads_started":1}
I20260812 00:21:02.781715 23694 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:02.868731 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 23555
I20260812 00:21:02.891878 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 23151
I20260812 00:21:02.893211 23217 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:03.002452 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 23151
2026-08-12T00:21:03Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4404 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:21:03 dist-test-slave-njxd krb5kdc[23720](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:21:03 dist-test-slave-njxd krb5kdc[23720](info): set up 2 sockets
Aug 12 00:21:03 dist-test-slave-njxd krb5kdc[23720](info): commencing operation
krb5kdc: starting...
W20260812 00:21:04.201695 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.000s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:21:04 dist-test-slave-njxd krb5kdc[23720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494064, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:21:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:21:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:21:04.481812 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:37219
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:45809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:37219
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:04.849844 23733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:04.850199 23733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:04.850310 23733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:04.858109 23733 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:21:04.858258 23733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:04.858361 23733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:04.858471 23733 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:21:04.858574 23733 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:21:04.869447 23733 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:45809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:37219
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:37219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:04.870985 23733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:04.872467 23733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:04.885306 23739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:04.885349 23742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:04.885380 23740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:04.886989 23733 server_base.cc:1034] running on GCE node
I20260812 00:21:04.887951 23733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:04.889676 23733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:04.890951 23733 hybrid_clock.cc:648] HybridClock initialized: now 1786494064890907 us; error 58 us; skew 500 ppm
I20260812 00:21:04.891372 23733 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:04 dist-test-slave-njxd krb5kdc[23720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494064, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:04.894964 23733 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:21:04.896344 23733 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:04.896498 23733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:04.896864 23733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:04.900336 23733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "4e86394885f244fda3f4cfeb6b6ddb22"
format_stamp: "Formatted at 2026-08-12 00:21:04 on dist-test-slave-njxd"
server_key: "2f0bf03a9f8ebe9840667b9c56c382da"
server_key_iv: "a8dabb40a00a1f696806068530f6978e"
server_key_version: "encryptionkey@0"
I20260812 00:21:04.901278 23733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "4e86394885f244fda3f4cfeb6b6ddb22"
format_stamp: "Formatted at 2026-08-12 00:21:04 on dist-test-slave-njxd"
server_key: "2f0bf03a9f8ebe9840667b9c56c382da"
server_key_iv: "a8dabb40a00a1f696806068530f6978e"
server_key_version: "encryptionkey@0"
I20260812 00:21:04.907181 23733 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 00:21:04.911262 23750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:04.912853 23733 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260812 00:21:04.913079 23733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "4e86394885f244fda3f4cfeb6b6ddb22"
format_stamp: "Formatted at 2026-08-12 00:21:04 on dist-test-slave-njxd"
server_key: "2f0bf03a9f8ebe9840667b9c56c382da"
server_key_iv: "a8dabb40a00a1f696806068530f6978e"
server_key_version: "encryptionkey@0"
I20260812 00:21:04.913353 23733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:04.960623 23733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:04.965770 23733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:04.966102 23733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:04.986682 23733 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:37219
I20260812 00:21:04.986682 23810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:37219 every 8 connection(s)
I20260812 00:21:04.987797 23733 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:21:04.991338 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 23733
I20260812 00:21:04.991580 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:21:04.992486 19087 external_mini_cluster.cc:1428] Setting key 0521da10b5a494b26a4c51b67ce9a8f0
I20260812 00:21:04.992554 23811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 00:21:05 dist-test-slave-njxd krb5kdc[23720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494064, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:21:05.010524 23811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22: Bootstrap starting.
I20260812 00:21:05.016013 23811 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:05.017535 23811 log.cc:824] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:05.021668 23811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22: No bootstrap required, opened a new log
I20260812 00:21:05.022753 23814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:04.994933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48364 (local address 127.18.163.254:37219)
0812 00:21:04.995860 (+ 927us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:04.995874 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:04.995925 (+ 51us) server_negotiation.cc:407] Connection header received
0812 00:21:04.998058 (+ 2133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:04.998089 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:04.998659 (+ 570us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:04.999171 (+ 512us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:05.001339 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:05.002808 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:05.004706 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:05.005504 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:05.005765 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:05.011980 (+ 6215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:05.011995 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:05.012023 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:05.012104 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:05.016890 (+ 4786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:05.018065 (+ 1175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:05.018075 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:05.018087 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:05.018386 (+ 299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:05.019000 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:05.019005 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:05.019007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:05.019835 (+ 828us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:05.020137 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:05.020648 (+ 511us) server_negotiation.cc:299] Negotiation successful
0812 00:21:05.021155 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":423,"threads_started":1}
I20260812 00:21:05.030544 23811 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e86394885f244fda3f4cfeb6b6ddb22" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37219 } }
I20260812 00:21:05.030983 23811 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:05.031121 23811 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e86394885f244fda3f4cfeb6b6ddb22, State: Initialized, Role: FOLLOWER
I20260812 00:21:05.031739 23811 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e86394885f244fda3f4cfeb6b6ddb22" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37219 } }
I20260812 00:21:05.032058 23811 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:21:05.032229 23811 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:21:05.032429 23811 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:05.035487 23811 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e86394885f244fda3f4cfeb6b6ddb22" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37219 } }
I20260812 00:21:05.036017 23811 leader_election.cc:302] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e86394885f244fda3f4cfeb6b6ddb22; no voters:
I20260812 00:21:05.036607 23811 leader_election.cc:288] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:21:05.036775 23816 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:05.037546 23816 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [term 1 LEADER]: Becoming Leader. State: Replica: 4e86394885f244fda3f4cfeb6b6ddb22, State: Running, Role: LEADER
I20260812 00:21:05.038187 23816 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e86394885f244fda3f4cfeb6b6ddb22" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37219 } }
I20260812 00:21:05.040215 23811 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:21:05.041519 23818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e86394885f244fda3f4cfeb6b6ddb22. Latest consensus state: current_term: 1 leader_uuid: "4e86394885f244fda3f4cfeb6b6ddb22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e86394885f244fda3f4cfeb6b6ddb22" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37219 } } }
I20260812 00:21:05.041519 23817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e86394885f244fda3f4cfeb6b6ddb22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e86394885f244fda3f4cfeb6b6ddb22" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37219 } } }
I20260812 00:21:05.042073 23817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:05.044754 23818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:05.045882 23820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:21:05.054343 23820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:21:05.065728 23820 catalog_manager.cc:1347] Generated new cluster ID: 9d0da349ec934f01bd4fdfe4c42d6199
I20260812 00:21:05.065874 23820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:21:05.075016 23820 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:21:05.076893 23820 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:21:05.088199 23820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22: Generated new TSK 0
I20260812 00:21:05.089148 23820 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:21:05.155367 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37219
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:45809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:05.534094 23841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:05.534432 23841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:05.534639 23841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:05.543040 23841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:05.543212 23841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:05.543419 23841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:21:05.554633 23841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:45809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37219
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:05.556183 23841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:05.557790 23841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:05.573338 23846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:05.573386 23847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:05.573282 23849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:05.574818 23841 server_base.cc:1034] running on GCE node
I20260812 00:21:05.575541 23841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:05.576686 23841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:05.577955 23841 hybrid_clock.cc:648] HybridClock initialized: now 1786494065577879 us; error 70 us; skew 500 ppm
I20260812 00:21:05.578356 23841 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:05 dist-test-slave-njxd krb5kdc[23720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494065, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:05.581916 23841 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:21:05.583302 23841 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:05.583462 23841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:05.583839 23841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:05.587345 23841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "522130366c5f4b8798201b57d2e0af95"
format_stamp: "Formatted at 2026-08-12 00:21:05 on dist-test-slave-njxd"
server_key: "9764c41b98fb8fa80e76d05c480ca825"
server_key_iv: "5e1c0004272d11dee0db5d021f2ba479"
server_key_version: "encryptionkey@0"
I20260812 00:21:05.588354 23841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "522130366c5f4b8798201b57d2e0af95"
format_stamp: "Formatted at 2026-08-12 00:21:05 on dist-test-slave-njxd"
server_key: "9764c41b98fb8fa80e76d05c480ca825"
server_key_iv: "5e1c0004272d11dee0db5d021f2ba479"
server_key_version: "encryptionkey@0"
I20260812 00:21:05.594918 23841 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260812 00:21:05.599138 23856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:05.600703 23841 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:21:05.600953 23841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "522130366c5f4b8798201b57d2e0af95"
format_stamp: "Formatted at 2026-08-12 00:21:05 on dist-test-slave-njxd"
server_key: "9764c41b98fb8fa80e76d05c480ca825"
server_key_iv: "5e1c0004272d11dee0db5d021f2ba479"
server_key_version: "encryptionkey@0"
I20260812 00:21:05.601238 23841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:05.619453 23841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:05.624372 23841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:05.624709 23841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:05.625896 23841 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:05.627475 23841 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:05.627612 23841 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:05.627760 23841 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:05.627867 23841 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:05.664827 23841 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:33557
I20260812 00:21:05.664878 23986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:33557 every 8 connection(s)
I20260812 00:21:05.665906 23841 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:21:05.674654 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 23841
I20260812 00:21:05.674904 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:21:05.675601 19087 external_mini_cluster.cc:1428] Setting key bd4eee31b2d1a582245cfa766226820f
Aug 12 00:21:05 dist-test-slave-njxd krb5kdc[23720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494065, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:21:05.688064 23990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:05.668756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:52415 (local address 127.18.163.254:37219)
0812 00:21:05.669294 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:05.669299 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:05.670324 (+ 1025us) server_negotiation.cc:407] Connection header received
0812 00:21:05.672332 (+ 2008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:05.672338 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:05.672459 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:05.672590 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:05.674432 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:05.675317 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:05.677228 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:05.677842 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:05.677985 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:05.681921 (+ 3936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:05.681926 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:05.681930 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:05.681966 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:05.684550 (+ 2584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:05.685448 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:05.685453 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:05.685455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:05.685656 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:05.686145 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:05.686150 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:05.686153 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:05.686444 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:05.686610 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:05.687414 (+ 804us) server_negotiation.cc:299] Negotiation successful
0812 00:21:05.687680 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":287,"threads_started":1}
I20260812 00:21:05.689189 23991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:05.669279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:37219 (local address 127.18.163.193:52415)
0812 00:21:05.670126 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:05.670182 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:05.672014 (+ 1832us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:05.672872 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:05.672882 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:05.673484 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:05.674225 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:05.674246 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:05.675508 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:05.675512 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:05.677058 (+ 1546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:05.677072 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:05.678108 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:05.678116 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:05.678358 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:05.679106 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:05.679136 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:05.681634 (+ 2498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:05.684740 (+ 3106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:05.684752 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:05.684772 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:05.685286 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:05.685779 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:05.685784 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:05.685788 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:05.686008 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:05.686585 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:05.686596 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:05.686985 (+ 389us) client_negotiation.cc:769] Sending connection context
0812 00:21:05.687296 (+ 311us) client_negotiation.cc:240] Negotiation successful
0812 00:21:05.687919 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":385,"threads_started":1}
I20260812 00:21:05.691058 23987 heartbeater.cc:347] Connected to a master server at 127.18.163.254:37219
I20260812 00:21:05.691443 23987 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:05.692461 23987 heartbeater.cc:511] Master 127.18.163.254:37219 requested a full tablet report, sending...
I20260812 00:21:05.695367 23770 ts_manager.cc:194] Registered new tserver with Master: 522130366c5f4b8798201b57d2e0af95 (127.18.163.193:33557)
I20260812 00:21:05.697696 23770 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:52415
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:21:05.737001 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37219
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:45809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:06.105937 23994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:06.106252 23994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:06.106453 23994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:06.114353 23994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:06.114517 23994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:06.114746 23994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:21:06.125643 23994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:45809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37219
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:06.127112 23994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:06.128557 23994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:06.142980 23999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:06.142947 24000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:06.143029 24004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:06.144166 23994 server_base.cc:1034] running on GCE node
I20260812 00:21:06.144840 23994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:06.146021 23994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:06.147250 23994 hybrid_clock.cc:648] HybridClock initialized: now 1786494066147202 us; error 47 us; skew 500 ppm
I20260812 00:21:06.147604 23994 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:06 dist-test-slave-njxd krb5kdc[23720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494066, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:06.151027 23994 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:21:06.152369 23994 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:06.152513 23994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:06.152873 23994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:06.156275 23994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "a09e4ef43d7e4853b2f366823c0125ae"
format_stamp: "Formatted at 2026-08-12 00:21:06 on dist-test-slave-njxd"
server_key: "87be2206fb301861f7a22269d409df4d"
server_key_iv: "0cf5ff160e1905ba6a59890a2367b144"
server_key_version: "encryptionkey@0"
I20260812 00:21:06.157200 23994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "a09e4ef43d7e4853b2f366823c0125ae"
format_stamp: "Formatted at 2026-08-12 00:21:06 on dist-test-slave-njxd"
server_key: "87be2206fb301861f7a22269d409df4d"
server_key_iv: "0cf5ff160e1905ba6a59890a2367b144"
server_key_version: "encryptionkey@0"
I20260812 00:21:06.163034 23994 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 00:21:06.167052 24010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:06.168570 23994 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:21:06.168798 23994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "a09e4ef43d7e4853b2f366823c0125ae"
format_stamp: "Formatted at 2026-08-12 00:21:06 on dist-test-slave-njxd"
server_key: "87be2206fb301861f7a22269d409df4d"
server_key_iv: "0cf5ff160e1905ba6a59890a2367b144"
server_key_version: "encryptionkey@0"
I20260812 00:21:06.169051 23994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:06.225075 23994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:06.229861 23994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:06.230195 23994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:06.231328 23994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:06.232939 23994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:06.233080 23994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:06.233228 23994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:06.233322 23994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:06.270105 23994 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:45685
I20260812 00:21:06.270201 24132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:45685 every 8 connection(s)
I20260812 00:21:06.271080 23994 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:21:06.276782 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 23994
I20260812 00:21:06.277033 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:21:06.277551 19087 external_mini_cluster.cc:1428] Setting key ad94082cd11a324bdd880843fe23f567
Aug 12 00:21:06 dist-test-slave-njxd krb5kdc[23720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494066, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:21:06.295454 24135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:06.273891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:56299 (local address 127.18.163.254:37219)
0812 00:21:06.274401 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:06.274407 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:06.275563 (+ 1156us) server_negotiation.cc:407] Connection header received
0812 00:21:06.277660 (+ 2097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:06.277667 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:06.277785 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:06.277917 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:06.279879 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.281011 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.283082 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.283878 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.284038 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:06.288395 (+ 4357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:06.288400 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:06.288404 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:06.288443 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:06.291817 (+ 3374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:06.292666 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:06.292671 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:06.292673 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:06.292840 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:06.293432 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:06.293435 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:06.293437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:06.293817 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:06.293939 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:06.294969 (+ 1030us) server_negotiation.cc:299] Negotiation successful
0812 00:21:06.295172 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":244,"threads_started":1}
I20260812 00:21:06.297282 24136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:06.274572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:37219 (local address 127.18.163.194:56299)
0812 00:21:06.275372 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:06.275421 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:06.277304 (+ 1883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:06.278160 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:06.278169 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:06.278910 (+ 741us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:06.279651 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:06.279682 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.281229 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.281233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:06.282901 (+ 1668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:06.282918 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.284162 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.284168 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:06.284391 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:06.285175 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:06.285202 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:06.288071 (+ 2869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:06.292009 (+ 3938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:06.292018 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:06.292034 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:06.292525 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:06.292983 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:06.292991 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:06.292997 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:06.293308 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:06.293957 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:06.293969 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:06.294515 (+ 546us) client_negotiation.cc:769] Sending connection context
0812 00:21:06.294882 (+ 367us) client_negotiation.cc:240] Negotiation successful
0812 00:21:06.295553 (+ 671us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":317,"threads_started":1}
I20260812 00:21:06.299117 24133 heartbeater.cc:347] Connected to a master server at 127.18.163.254:37219
I20260812 00:21:06.299465 24133 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:06.300202 24133 heartbeater.cc:511] Master 127.18.163.254:37219 requested a full tablet report, sending...
I20260812 00:21:06.302053 23770 ts_manager.cc:194] Registered new tserver with Master: a09e4ef43d7e4853b2f366823c0125ae (127.18.163.194:45685)
I20260812 00:21:06.303436 23770 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:56299
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
I20260812 00:21:06.342645 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37219
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:45809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:21:06.702481 23987 heartbeater.cc:503] Master 127.18.163.254:37219 was elected leader, sending a full tablet report...
W20260812 00:21:06.713933 24139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:06.714251 24139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:06.714355 24139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:06.722218 24139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:06.722353 24139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:06.722478 24139 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:21:06.733122 24139 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:45809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37219
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:06.734650 24139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:06.736037 24139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:06.750397 24146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:06.750423 24147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:06.750468 24149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:06.751716 24139 server_base.cc:1034] running on GCE node
I20260812 00:21:06.752481 24139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:06.753650 24139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:06.754897 24139 hybrid_clock.cc:648] HybridClock initialized: now 1786494066754853 us; error 46 us; skew 500 ppm
I20260812 00:21:06.755270 24139 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:06 dist-test-slave-njxd krb5kdc[23720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494066, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:06.758697 24139 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:21:06.760077 24139 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:06.760228 24139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:06.760587 24139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:06.763885 24139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "687287e30cde4b6996a7893ab5c2a4f1"
format_stamp: "Formatted at 2026-08-12 00:21:06 on dist-test-slave-njxd"
server_key: "208fd7eb0960337f3f749d0e3d9f1b61"
server_key_iv: "9247e958110ea7e8864079436cdeafd6"
server_key_version: "encryptionkey@0"
I20260812 00:21:06.764868 24139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "687287e30cde4b6996a7893ab5c2a4f1"
format_stamp: "Formatted at 2026-08-12 00:21:06 on dist-test-slave-njxd"
server_key: "208fd7eb0960337f3f749d0e3d9f1b61"
server_key_iv: "9247e958110ea7e8864079436cdeafd6"
server_key_version: "encryptionkey@0"
I20260812 00:21:06.770772 24139 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 00:21:06.774782 24157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:06.776160 24139 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:21:06.776367 24139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "687287e30cde4b6996a7893ab5c2a4f1"
format_stamp: "Formatted at 2026-08-12 00:21:06 on dist-test-slave-njxd"
server_key: "208fd7eb0960337f3f749d0e3d9f1b61"
server_key_iv: "9247e958110ea7e8864079436cdeafd6"
server_key_version: "encryptionkey@0"
I20260812 00:21:06.776619 24139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:06.796533 24139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:06.801024 24139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:06.801345 24139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:06.802489 24139 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:06.804107 24139 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:06.804235 24139 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:06.804371 24139 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:06.804461 24139 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:06.840205 24139 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:40837
I20260812 00:21:06.840299 24279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:40837 every 8 connection(s)
I20260812 00:21:06.841219 24139 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:21:06.841938 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 24139
I20260812 00:21:06.842154 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:21:06.842720 19087 external_mini_cluster.cc:1428] Setting key 0aa5fdc1234a1955155eb72417b5314b
Aug 12 00:21:06 dist-test-slave-njxd krb5kdc[23720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494066, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:21:06.863041 24283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:06.844051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:51695 (local address 127.18.163.254:37219)
0812 00:21:06.844566 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:06.844570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:06.845871 (+ 1301us) server_negotiation.cc:407] Connection header received
0812 00:21:06.847991 (+ 2120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:06.847996 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:06.848107 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:06.848233 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:06.849907 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.850757 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.852456 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.852924 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.853062 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:06.856739 (+ 3677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:06.856744 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:06.856747 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:06.856782 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:06.860043 (+ 3261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:06.860843 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:06.860847 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:06.860850 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:06.860975 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:06.861371 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:06.861374 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:06.861376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:06.861732 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:06.861860 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:06.862559 (+ 699us) server_negotiation.cc:299] Negotiation successful
0812 00:21:06.862765 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":256,"threads_started":1}
I20260812 00:21:06.864099 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:06.844748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:37219 (local address 127.18.163.195:51695)
0812 00:21:06.845714 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:06.845758 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:06.847718 (+ 1960us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:06.848477 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:06.848487 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:06.849063 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:06.849711 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:06.849737 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.850934 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.850938 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:06.852281 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:06.852295 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.853191 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.853199 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:06.853431 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:06.854177 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:06.854201 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:06.856488 (+ 2287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:06.860206 (+ 3718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:06.860214 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:06.860230 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:06.860724 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:06.861071 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:06.861074 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:06.861076 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:06.861269 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:06.861854 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:06.861860 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:06.862215 (+ 355us) client_negotiation.cc:769] Sending connection context
0812 00:21:06.862450 (+ 235us) client_negotiation.cc:240] Negotiation successful
0812 00:21:06.862890 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":389,"threads_started":1}
I20260812 00:21:06.865554 24280 heartbeater.cc:347] Connected to a master server at 127.18.163.254:37219
I20260812 00:21:06.865963 24280 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:06.866722 24280 heartbeater.cc:511] Master 127.18.163.254:37219 requested a full tablet report, sending...
I20260812 00:21:06.868206 23770 ts_manager.cc:194] Registered new tserver with Master: 687287e30cde4b6996a7893ab5c2a4f1 (127.18.163.195:40837)
I20260812 00:21:06.869057 23770 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:51695
I20260812 00:21:06.871841 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:21:06.890308 24283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:06.876785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48368 (local address 127.18.163.254:37219)
0812 00:21:06.876973 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:06.876998 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:06.877501 (+ 503us) server_negotiation.cc:407] Connection header received
0812 00:21:06.877761 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:06.877766 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:06.877848 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:06.877951 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:06.879481 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.880316 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.881651 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.882101 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.882239 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:06.884704 (+ 2465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:06.884718 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:06.884721 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:06.884756 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:06.887445 (+ 2689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:06.888185 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:06.888191 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:06.888195 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:06.888339 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:06.888735 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:06.888741 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:06.888746 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:06.889106 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:06.889382 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:06.889744 (+ 362us) server_negotiation.cc:299] Negotiation successful
0812 00:21:06.889990 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 00:21:06.894719 23770 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48368:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:21:06.902577 23770 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:21:06.931143 24297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:06.915813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:40837 (local address 127.0.0.1:56084)
0812 00:21:06.917089 (+ 1276us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:06.917142 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:06.917433 (+ 291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:06.919281 (+ 1848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:06.919293 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:06.919338 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:06.919920 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:06.919939 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.923259 (+ 3320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.923270 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:06.926818 (+ 3548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:06.926851 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.929909 (+ 3058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.929917 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:06.930248 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:06.930317 (+ 69us) client_negotiation.cc:769] Sending connection context
0812 00:21:06.930462 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 00:21:06.930705 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":975,"thread_start_us":795,"threads_started":1}
I20260812 00:21:06.931517 24299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:06.916171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56084 (local address 127.18.163.195:40837)
0812 00:21:06.918375 (+ 2204us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:06.918389 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:06.918435 (+ 46us) server_negotiation.cc:407] Connection header received
0812 00:21:06.918567 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:06.918578 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:06.918936 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:06.920231 (+ 1295us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:06.920672 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.923013 (+ 2341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.927192 (+ 4179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.929554 (+ 2362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.930609 (+ 1055us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:06.930834 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:06.930919 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 00:21:06.931125 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1842,"thread_start_us":1677,"threads_started":1}
I20260812 00:21:06.936399 24211 tablet_service.cc:1467] Processing CreateTablet for tablet 38d9627531f54e6ea721c6e8ffc8d166 (DEFAULT_TABLE table=test-table [id=48972a6d7b4e48b598a37e2c5ea4632f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:06.938299 24211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38d9627531f54e6ea721c6e8ffc8d166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:06.939889 24297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:06.919396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:45685 (local address 127.0.0.1:45830)
0812 00:21:06.931428 (+ 12032us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:06.931450 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:06.931606 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:06.932950 (+ 1344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:06.932954 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:06.932980 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:06.933245 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:06.933259 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.934739 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.934745 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:06.936547 (+ 1802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:06.936564 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.938921 (+ 2357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.938927 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:06.939139 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:06.939219 (+ 80us) client_negotiation.cc:769] Sending connection context
0812 00:21:06.939314 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 00:21:06.939482 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11926,"mutex_wait_us":1,"thread_start_us":12455,"threads_started":1}
I20260812 00:21:06.939942 24302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:06.919706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45830 (local address 127.18.163.194:45685)
0812 00:21:06.929972 (+ 10266us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:06.929983 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:06.932286 (+ 2303us) server_negotiation.cc:407] Connection header received
0812 00:21:06.932415 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:06.932423 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:06.932718 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:06.932947 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:06.933433 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.934578 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.936771 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.938715 (+ 1944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.938910 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:06.939302 (+ 392us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:06.939385 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 00:21:06.939585 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10081,"thread_start_us":10027,"threads_started":1}
I20260812 00:21:06.940547 24298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:06.916061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:33557 (local address 127.0.0.1:54032)
0812 00:21:06.918912 (+ 2851us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:06.918933 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:06.919085 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:06.932646 (+ 13561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:06.932651 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:06.932678 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:06.933083 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:06.933096 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.935395 (+ 2299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.935400 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:06.937539 (+ 2139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:06.937555 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.939634 (+ 2079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.939641 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:06.939850 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:06.939889 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 00:21:06.939963 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 00:21:06.940193 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2709,"thread_start_us":3838,"threads_started":1}
I20260812 00:21:06.941465 24300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:06.916817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54032 (local address 127.18.163.193:33557)
0812 00:21:06.930630 (+ 13813us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:06.930642 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:06.930686 (+ 44us) server_negotiation.cc:407] Connection header received
0812 00:21:06.930826 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:06.930838 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:06.932354 (+ 1516us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:06.933256 (+ 902us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:06.933546 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.935231 (+ 1685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.937813 (+ 2582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:06.939369 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:06.940574 (+ 1205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:06.940772 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:06.940854 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 00:21:06.941103 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13575,"thread_start_us":13358,"threads_started":1}
I20260812 00:21:06.944718 24064 tablet_service.cc:1467] Processing CreateTablet for tablet 38d9627531f54e6ea721c6e8ffc8d166 (DEFAULT_TABLE table=test-table [id=48972a6d7b4e48b598a37e2c5ea4632f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:06.945627 23912 tablet_service.cc:1467] Processing CreateTablet for tablet 38d9627531f54e6ea721c6e8ffc8d166 (DEFAULT_TABLE table=test-table [id=48972a6d7b4e48b598a37e2c5ea4632f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:06.946282 24064 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38d9627531f54e6ea721c6e8ffc8d166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:06.947166 23912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38d9627531f54e6ea721c6e8ffc8d166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:06.954869 24303 tablet_bootstrap.cc:492] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1: Bootstrap starting.
I20260812 00:21:06.959084 24303 tablet_bootstrap.cc:654] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:06.960625 24304 tablet_bootstrap.cc:492] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae: Bootstrap starting.
I20260812 00:21:06.962318 24305 tablet_bootstrap.cc:492] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95: Bootstrap starting.
I20260812 00:21:06.962285 24303 log.cc:824] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:06.964897 24304 tablet_bootstrap.cc:654] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:06.965924 24305 tablet_bootstrap.cc:654] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:06.966167 24304 log.cc:824] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:06.966672 24303 tablet_bootstrap.cc:492] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1: No bootstrap required, opened a new log
I20260812 00:21:06.967046 24303 ts_tablet_manager.cc:1397] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.002s
I20260812 00:21:06.967204 24305 log.cc:824] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:06.969406 24304 tablet_bootstrap.cc:492] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae: No bootstrap required, opened a new log
I20260812 00:21:06.969818 24304 ts_tablet_manager.cc:1397] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260812 00:21:06.970606 24305 tablet_bootstrap.cc:492] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95: No bootstrap required, opened a new log
I20260812 00:21:06.970882 24305 ts_tablet_manager.cc:1397] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260812 00:21:06.978361 24304 raft_consensus.cc:348] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687287e30cde4b6996a7893ab5c2a4f1" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40837 } } peers { permanent_uuid: "522130366c5f4b8798201b57d2e0af95" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33557 } } peers { permanent_uuid: "a09e4ef43d7e4853b2f366823c0125ae" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45685 } }
I20260812 00:21:06.978825 24304 raft_consensus.cc:374] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:06.978981 24304 raft_consensus.cc:729] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09e4ef43d7e4853b2f366823c0125ae, State: Initialized, Role: FOLLOWER
I20260812 00:21:06.978760 24303 raft_consensus.cc:348] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687287e30cde4b6996a7893ab5c2a4f1" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40837 } } peers { permanent_uuid: "522130366c5f4b8798201b57d2e0af95" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33557 } } peers { permanent_uuid: "a09e4ef43d7e4853b2f366823c0125ae" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45685 } }
I20260812 00:21:06.979239 24303 raft_consensus.cc:374] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:06.979406 24303 raft_consensus.cc:729] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687287e30cde4b6996a7893ab5c2a4f1, State: Initialized, Role: FOLLOWER
I20260812 00:21:06.979825 24304 consensus_queue.cc:260] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687287e30cde4b6996a7893ab5c2a4f1" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40837 } } peers { permanent_uuid: "522130366c5f4b8798201b57d2e0af95" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33557 } } peers { permanent_uuid: "a09e4ef43d7e4853b2f366823c0125ae" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45685 } }
I20260812 00:21:06.980034 24303 consensus_queue.cc:260] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687287e30cde4b6996a7893ab5c2a4f1" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40837 } } peers { permanent_uuid: "522130366c5f4b8798201b57d2e0af95" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33557 } } peers { permanent_uuid: "a09e4ef43d7e4853b2f366823c0125ae" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45685 } }
I20260812 00:21:06.981630 24280 heartbeater.cc:503] Master 127.18.163.254:37219 was elected leader, sending a full tablet report...
I20260812 00:21:06.982240 24303 ts_tablet_manager.cc:1428] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1: Time spent starting tablet: real 0.015s user 0.011s sys 0.003s
I20260812 00:21:06.982278 24305 raft_consensus.cc:348] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687287e30cde4b6996a7893ab5c2a4f1" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40837 } } peers { permanent_uuid: "522130366c5f4b8798201b57d2e0af95" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33557 } } peers { permanent_uuid: "a09e4ef43d7e4853b2f366823c0125ae" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45685 } }
I20260812 00:21:06.982842 24305 raft_consensus.cc:374] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:06.983001 24305 raft_consensus.cc:729] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 522130366c5f4b8798201b57d2e0af95, State: Initialized, Role: FOLLOWER
I20260812 00:21:06.983469 24133 heartbeater.cc:503] Master 127.18.163.254:37219 was elected leader, sending a full tablet report...
I20260812 00:21:06.984215 24304 ts_tablet_manager.cc:1428] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
I20260812 00:21:06.984398 24305 consensus_queue.cc:260] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687287e30cde4b6996a7893ab5c2a4f1" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40837 } } peers { permanent_uuid: "522130366c5f4b8798201b57d2e0af95" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33557 } } peers { permanent_uuid: "a09e4ef43d7e4853b2f366823c0125ae" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45685 } }
I20260812 00:21:06.987643 24305 ts_tablet_manager.cc:1428] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95: Time spent starting tablet: real 0.017s user 0.011s sys 0.004s
W20260812 00:21:07.023258 24134 tablet.cc:2369] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:21:07.072778 24310 raft_consensus.cc:482] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:21:07.073184 24310 raft_consensus.cc:504] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687287e30cde4b6996a7893ab5c2a4f1" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40837 } } peers { permanent_uuid: "522130366c5f4b8798201b57d2e0af95" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33557 } } peers { permanent_uuid: "a09e4ef43d7e4853b2f366823c0125ae" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45685 } }
I20260812 00:21:07.075763 24310 leader_election.cc:288] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 522130366c5f4b8798201b57d2e0af95 (127.18.163.193:33557), a09e4ef43d7e4853b2f366823c0125ae (127.18.163.194:45685)
I20260812 00:21:07.083171 24300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:07.076346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:32863 (local address 127.18.163.193:33557)
0812 00:21:07.076562 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:07.076569 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:07.076680 (+ 111us) server_negotiation.cc:407] Connection header received
0812 00:21:07.076974 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:07.076982 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:07.077104 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:07.077235 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:07.077717 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:07.078886 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:07.081108 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:07.082202 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:07.082335 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:07.082390 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:07.082783 (+ 393us) server_negotiation.cc:299] Negotiation successful
0812 00:21:07.082882 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 00:21:07.083247 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:07.076375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:33557 (local address 127.18.163.195:32863)
0812 00:21:07.076570 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:07.076594 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:07.076772 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:07.077289 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:07.077294 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:07.077330 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:07.077519 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:07.077527 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:07.079047 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:07.079053 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:07.080904 (+ 1851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:07.080917 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:07.082360 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:07.082368 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:07.082600 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:07.082639 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 00:21:07.082750 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 00:21:07.082894 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 00:21:07.083995 24302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:07.076333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:45333 (local address 127.18.163.194:45685)
0812 00:21:07.076561 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:07.076580 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:07.077627 (+ 1047us) server_negotiation.cc:407] Connection header received
0812 00:21:07.077825 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:07.077829 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:07.077895 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:07.078002 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:07.078615 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:07.079718 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:07.081865 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:07.082904 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:07.083069 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:07.083143 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:07.083550 (+ 407us) server_negotiation.cc:299] Negotiation successful
0812 00:21:07.083733 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 00:21:07.084683 24314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:07.076375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:45685 (local address 127.18.163.195:45333)
0812 00:21:07.077470 (+ 1095us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:07.077487 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:07.077671 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:07.078023 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:07.078027 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:07.078058 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:07.078448 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:07.078460 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:07.079919 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:07.079923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:07.081650 (+ 1727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:07.081667 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:07.083122 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:07.083130 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:07.083331 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:07.083372 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 00:21:07.084263 (+ 891us) client_negotiation.cc:240] Negotiation successful
0812 00:21:07.084386 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":945,"mutex_wait_us":221,"thread_start_us":447,"threads_started":1}
I20260812 00:21:07.084524 23937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d9627531f54e6ea721c6e8ffc8d166" candidate_uuid: "687287e30cde4b6996a7893ab5c2a4f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "522130366c5f4b8798201b57d2e0af95" is_pre_election: true
I20260812 00:21:07.085104 23937 raft_consensus.cc:2454] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687287e30cde4b6996a7893ab5c2a4f1 in term 0.
I20260812 00:21:07.085909 24163 leader_election.cc:302] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 522130366c5f4b8798201b57d2e0af95, 687287e30cde4b6996a7893ab5c2a4f1; no voters:
I20260812 00:21:07.085827 24086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d9627531f54e6ea721c6e8ffc8d166" candidate_uuid: "687287e30cde4b6996a7893ab5c2a4f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09e4ef43d7e4853b2f366823c0125ae" is_pre_election: true
I20260812 00:21:07.086341 24310 raft_consensus.cc:2781] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:21:07.086373 24086 raft_consensus.cc:2454] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687287e30cde4b6996a7893ab5c2a4f1 in term 0.
I20260812 00:21:07.086529 24310 raft_consensus.cc:482] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:21:07.086658 24310 raft_consensus.cc:3037] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:07.089012 24310 raft_consensus.cc:504] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687287e30cde4b6996a7893ab5c2a4f1" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40837 } } peers { permanent_uuid: "522130366c5f4b8798201b57d2e0af95" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33557 } } peers { permanent_uuid: "a09e4ef43d7e4853b2f366823c0125ae" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45685 } }
I20260812 00:21:07.089676 24310 leader_election.cc:288] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [CANDIDATE]: Term 1 election: Requested vote from peers 522130366c5f4b8798201b57d2e0af95 (127.18.163.193:33557), a09e4ef43d7e4853b2f366823c0125ae (127.18.163.194:45685)
I20260812 00:21:07.090281 24086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d9627531f54e6ea721c6e8ffc8d166" candidate_uuid: "687287e30cde4b6996a7893ab5c2a4f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09e4ef43d7e4853b2f366823c0125ae"
I20260812 00:21:07.090289 23937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38d9627531f54e6ea721c6e8ffc8d166" candidate_uuid: "687287e30cde4b6996a7893ab5c2a4f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "522130366c5f4b8798201b57d2e0af95"
I20260812 00:21:07.090502 24086 raft_consensus.cc:3037] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:07.090518 23937 raft_consensus.cc:3037] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:07.092872 24086 raft_consensus.cc:2454] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687287e30cde4b6996a7893ab5c2a4f1 in term 1.
I20260812 00:21:07.092913 23937 raft_consensus.cc:2454] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687287e30cde4b6996a7893ab5c2a4f1 in term 1.
W20260812 00:21:07.093184 24281 tablet.cc:2369] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:21:07.093436 24159 leader_election.cc:302] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687287e30cde4b6996a7893ab5c2a4f1, a09e4ef43d7e4853b2f366823c0125ae; no voters:
I20260812 00:21:07.093833 24310 raft_consensus.cc:2781] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:07.094349 24310 raft_consensus.cc:686] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [term 1 LEADER]: Becoming Leader. State: Replica: 687287e30cde4b6996a7893ab5c2a4f1, State: Running, Role: LEADER
I20260812 00:21:07.094877 24310 consensus_queue.cc:237] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687287e30cde4b6996a7893ab5c2a4f1" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40837 } } peers { permanent_uuid: "522130366c5f4b8798201b57d2e0af95" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33557 } } peers { permanent_uuid: "a09e4ef43d7e4853b2f366823c0125ae" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45685 } }
I20260812 00:21:07.099980 23767 catalog_manager.cc:5495] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 687287e30cde4b6996a7893ab5c2a4f1 (127.18.163.195). New cstate: current_term: 1 leader_uuid: "687287e30cde4b6996a7893ab5c2a4f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687287e30cde4b6996a7893ab5c2a4f1" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "522130366c5f4b8798201b57d2e0af95" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09e4ef43d7e4853b2f366823c0125ae" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45685 } health_report { overall_health: UNKNOWN } } }
I20260812 00:21:07.131453 24299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:07.126156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56096 (local address 127.18.163.195:40837)
0812 00:21:07.126390 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:07.126395 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:07.126415 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:21:07.126512 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:07.126516 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:07.126615 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:07.126755 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:21:07.127109 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:07.127974 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:07.129277 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:07.129707 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:07.129803 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:07.130291 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:21:07.130846 (+ 555us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:21:07.130957 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:07.131057 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 00:21:07.131138 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 00:21:07.140188 24086 raft_consensus.cc:1261] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae [term 1 FOLLOWER]: Refusing update from remote peer 687287e30cde4b6996a7893ab5c2a4f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:07.140280 23937 raft_consensus.cc:1261] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95 [term 1 FOLLOWER]: Refusing update from remote peer 687287e30cde4b6996a7893ab5c2a4f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:07.141426 24315 consensus_queue.cc:1035] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09e4ef43d7e4853b2f366823c0125ae" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 45685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:07.141916 24310 consensus_queue.cc:1035] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "522130366c5f4b8798201b57d2e0af95" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:07.172113 23769 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:21:07.172461 23769 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:21:07.176771 23769 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4e86394885f244fda3f4cfeb6b6ddb22: Sending DeleteTablet for 3 replicas of tablet 38d9627531f54e6ea721c6e8ffc8d166
I20260812 00:21:07.178181 23912 tablet_service.cc:1514] Processing DeleteTablet for tablet 38d9627531f54e6ea721c6e8ffc8d166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:07 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:54032
I20260812 00:21:07.178143 24211 tablet_service.cc:1514] Processing DeleteTablet for tablet 38d9627531f54e6ea721c6e8ffc8d166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:07 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:56084
I20260812 00:21:07.179013 24064 tablet_service.cc:1514] Processing DeleteTablet for tablet 38d9627531f54e6ea721c6e8ffc8d166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:07 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:45830
I20260812 00:21:07.180091 24332 tablet_replica.cc:330] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae: stopping tablet replica
I20260812 00:21:07.180647 24332 raft_consensus.cc:2229] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:07.181294 24332 raft_consensus.cc:2258] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:07.183033 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 23841
I20260812 00:21:07.192179 24331 tablet_replica.cc:330] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1: stopping tablet replica
I20260812 00:21:07.192865 24331 raft_consensus.cc:2229] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:21:07.193823 24331 raft_consensus.cc:2258] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:07.194821 24332 ts_tablet_manager.cc:1905] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:07.194923 24330 tablet_replica.cc:330] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95: stopping tablet replica
I20260812 00:21:07.195343 24330 raft_consensus.cc:2229] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:07.195816 24330 raft_consensus.cc:2258] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:07.197301 24331 ts_tablet_manager.cc:1905] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:07.199551 24330 ts_tablet_manager.cc:1905] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:07.205461 24331 ts_tablet_manager.cc:1918] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:07.205801 24331 log.cc:1196] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/38d9627531f54e6ea721c6e8ffc8d166
I20260812 00:21:07.206563 24331 ts_tablet_manager.cc:1939] T 38d9627531f54e6ea721c6e8ffc8d166 P 687287e30cde4b6996a7893ab5c2a4f1: Deleting consensus metadata
I20260812 00:21:07.207190 24330 ts_tablet_manager.cc:1918] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:07.207504 24330 log.cc:1196] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/38d9627531f54e6ea721c6e8ffc8d166
I20260812 00:21:07.208138 24330 ts_tablet_manager.cc:1939] T 38d9627531f54e6ea721c6e8ffc8d166 P 522130366c5f4b8798201b57d2e0af95: Deleting consensus metadata
I20260812 00:21:07.208802 23754 catalog_manager.cc:4841] TS 687287e30cde4b6996a7893ab5c2a4f1 (127.18.163.195:40837): tablet 38d9627531f54e6ea721c6e8ffc8d166 (table test-table [id=48972a6d7b4e48b598a37e2c5ea4632f]) successfully deleted
I20260812 00:21:07.210779 23755 catalog_manager.cc:4841] TS 522130366c5f4b8798201b57d2e0af95 (127.18.163.193:33557): tablet 38d9627531f54e6ea721c6e8ffc8d166 (table test-table [id=48972a6d7b4e48b598a37e2c5ea4632f]) successfully deleted
I20260812 00:21:07.211272 24332 ts_tablet_manager.cc:1918] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:07.211476 24332 log.cc:1196] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/38d9627531f54e6ea721c6e8ffc8d166
I20260812 00:21:07.212262 24332 ts_tablet_manager.cc:1939] T 38d9627531f54e6ea721c6e8ffc8d166 P a09e4ef43d7e4853b2f366823c0125ae: Deleting consensus metadata
I20260812 00:21:07.213886 23753 catalog_manager.cc:4841] TS a09e4ef43d7e4853b2f366823c0125ae (127.18.163.194:45685): tablet 38d9627531f54e6ea721c6e8ffc8d166 (table test-table [id=48972a6d7b4e48b598a37e2c5ea4632f]) successfully deleted
Aug 12 00:21:07 dist-test-slave-njxd krb5kdc[23720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494064, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:21:07.223857 24300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:07.184758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54038 (local address 127.18.163.193:33557)
0812 00:21:07.184958 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:07.184966 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:07.202940 (+ 17974us) server_negotiation.cc:407] Connection header received
0812 00:21:07.203537 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:07.203544 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:07.203646 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:07.203728 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:07.206196 (+ 2468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:07.207397 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:07.209355 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:07.210076 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:07.210194 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:07.216161 (+ 5967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:07.216187 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:07.216210 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:07.216266 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:07.220474 (+ 4208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:07.221323 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:07.221334 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:07.221338 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:07.221548 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:07.222039 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:07.222047 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:07.222052 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:07.222607 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:07.222970 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:07.223174 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 00:21:07.223441 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 00:21:07.224606 23981 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:07.325232 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 23841
I20260812 00:21:07.355077 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 23994
Aug 12 00:21:07 dist-test-slave-njxd krb5kdc[23720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494064, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
I20260812 00:21:07.373512 24302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:07.356070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45840 (local address 127.18.163.194:45685)
0812 00:21:07.356260 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:07.356264 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:07.356285 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:21:07.356426 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:07.356431 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:07.356498 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:07.356591 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:07.358386 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:07.359177 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:07.361043 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:07.361514 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:07.361727 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:07.366995 (+ 5268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:07.367015 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:07.367032 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:07.367080 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:07.370402 (+ 3322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:07.371178 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:07.371186 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:07.371188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:07.371324 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:07.371747 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:07.371752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:07.371755 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:07.372210 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:07.372571 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:07.372870 (+ 299us) server_negotiation.cc:299] Negotiation successful
0812 00:21:07.373119 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 00:21:07.374317 24127 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:07.471908 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 23994
I20260812 00:21:07.495803 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 24139
Aug 12 00:21:07 dist-test-slave-njxd krb5kdc[23720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494064, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:21:07.515221 24299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:07.496696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56112 (local address 127.18.163.195:40837)
0812 00:21:07.496914 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:07.496920 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:07.496944 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:21:07.497072 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:07.497078 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:07.497202 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:07.497337 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:07.498705 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:07.499930 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:07.501322 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:07.502179 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:07.502347 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:07.506902 (+ 4555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:07.506925 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:07.506951 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:07.507005 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:07.511627 (+ 4622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:07.512595 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:07.512607 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:07.512611 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:07.512840 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:07.513269 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:07.513276 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:07.513285 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:07.513916 (+ 631us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:07.514300 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:07.514486 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 00:21:07.514770 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 00:21:07.516028 24275 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:07.648373 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 24139
I20260812 00:21:07.675273 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 23733
I20260812 00:21:07.676513 23804 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:07.791045 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 23733
2026-08-12T00:21:07Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4788 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T00:21:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:21:07Z Disabled control of system clock
I20260812 00:21:07.880908 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44905
--webserver_interface=127.18.163.254
--webserver_port=0
--builtin_ntp_servers=127.18.163.212:40033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:44905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 00:21:08.240535 24343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:08.240914 24343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:08.241081 24343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:08.249029 24343 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:21:08.249163 24343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:08.249262 24343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:08.249372 24343 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:21:08.249449 24343 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:21:08.259380 24343 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:40033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:44905
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:08.260860 24343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:08.262861 24343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:08.275687 24348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:08.275663 24352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:08.275722 24350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:08.277103 24343 server_base.cc:1034] running on GCE node
I20260812 00:21:08.278239 24343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:08.279969 24343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:08.281200 24343 hybrid_clock.cc:648] HybridClock initialized: now 1786494068281153 us; error 38 us; skew 500 ppm
I20260812 00:21:08.281695 24343 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:21:08.290678 24343 webserver.cc:460] Webserver started at http://127.18.163.254:37329/ using document root <none> and password file <none>
I20260812 00:21:08.291534 24343 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:08.291668 24343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:08.292060 24343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:08.295423 24343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "ab46c34653e640028dcf3f20fc365763"
format_stamp: "Formatted at 2026-08-12 00:21:08 on dist-test-slave-njxd"
server_key: "6e57e93e2028d1340ce811486d6bdaea"
server_key_iv: "f95080ea4763b26a295741e5d9947a7f"
server_key_version: "encryptionkey@0"
I20260812 00:21:08.296315 24343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "ab46c34653e640028dcf3f20fc365763"
format_stamp: "Formatted at 2026-08-12 00:21:08 on dist-test-slave-njxd"
server_key: "6e57e93e2028d1340ce811486d6bdaea"
server_key_iv: "f95080ea4763b26a295741e5d9947a7f"
server_key_version: "encryptionkey@0"
I20260812 00:21:08.302377 24343 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 00:21:08.306321 24362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:08.307869 24343 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:21:08.308094 24343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "ab46c34653e640028dcf3f20fc365763"
format_stamp: "Formatted at 2026-08-12 00:21:08 on dist-test-slave-njxd"
server_key: "6e57e93e2028d1340ce811486d6bdaea"
server_key_iv: "f95080ea4763b26a295741e5d9947a7f"
server_key_version: "encryptionkey@0"
I20260812 00:21:08.308362 24343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:08.314903 24343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:08.315837 24343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:08.316190 24343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:08.336596 24343 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:44905
I20260812 00:21:08.336632 24418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:44905 every 8 connection(s)
I20260812 00:21:08.338219 24343 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:21:08.339520 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 24343
I20260812 00:21:08.339782 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:21:08.340490 19087 external_mini_cluster.cc:1428] Setting key 447dc3140a02fb1e26c23b624741f0c0
I20260812 00:21:08.343261 24419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:08.351215 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:08.342811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39338 (local address 127.18.163.254:44905)
0812 00:21:08.344008 (+ 1197us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:08.344024 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:08.344081 (+ 57us) server_negotiation.cc:407] Connection header received
0812 00:21:08.346457 (+ 2376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:08.346489 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:08.347122 (+ 633us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:08.347626 (+ 504us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:08.348779 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:08.348787 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:08.348806 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:08.348825 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:08.348938 (+ 113us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:08.348963 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:08.349232 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:08.349380 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 00:21:08.349729 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":392,"threads_started":1}
I20260812 00:21:08.357391 24419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763: Bootstrap starting.
I20260812 00:21:08.360670 24419 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:08.361846 24419 log.cc:824] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:08.364876 24419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763: No bootstrap required, opened a new log
I20260812 00:21:08.372419 24419 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab46c34653e640028dcf3f20fc365763" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44905 } }
I20260812 00:21:08.372854 24419 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:08.372936 24419 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab46c34653e640028dcf3f20fc365763, State: Initialized, Role: FOLLOWER
I20260812 00:21:08.373505 24419 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab46c34653e640028dcf3f20fc365763" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44905 } }
I20260812 00:21:08.373869 24419 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:21:08.374022 24419 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:21:08.374255 24419 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:08.376740 24419 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab46c34653e640028dcf3f20fc365763" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44905 } }
I20260812 00:21:08.377321 24419 leader_election.cc:302] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab46c34653e640028dcf3f20fc365763; no voters:
I20260812 00:21:08.378084 24419 leader_election.cc:288] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:21:08.378278 24425 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:08.379173 24425 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [term 1 LEADER]: Becoming Leader. State: Replica: ab46c34653e640028dcf3f20fc365763, State: Running, Role: LEADER
I20260812 00:21:08.379789 24425 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab46c34653e640028dcf3f20fc365763" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44905 } }
I20260812 00:21:08.380403 24419 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:21:08.383101 24426 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab46c34653e640028dcf3f20fc365763" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab46c34653e640028dcf3f20fc365763" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44905 } } }
I20260812 00:21:08.383635 24426 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:08.383420 24427 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab46c34653e640028dcf3f20fc365763. Latest consensus state: current_term: 1 leader_uuid: "ab46c34653e640028dcf3f20fc365763" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab46c34653e640028dcf3f20fc365763" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44905 } } }
I20260812 00:21:08.383780 24427 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:08.386384 24435 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:21:08.392002 24435 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:21:08.402014 24435 catalog_manager.cc:1347] Generated new cluster ID: e81c7b4428aa4d5ba28011e2541adbd2
I20260812 00:21:08.402153 24435 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:21:08.432176 24435 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:21:08.432690 24435 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:21:08.442356 24435 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763: Generated new TSK 0
I20260812 00:21:08.443605 24435 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:21:08.456265 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44905
--builtin_ntp_servers=127.18.163.212:40033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 00:21:08.826962 24448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:08.827319 24448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:08.827488 24448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:08.835367 24448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:08.835517 24448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:08.835704 24448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:21:08.845664 24448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:40033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44905
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:08.847110 24448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:08.849046 24448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:08.863238 24456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:08.863554 24457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:08.863751 24459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:08.864774 24448 server_base.cc:1034] running on GCE node
I20260812 00:21:08.865514 24448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:08.866628 24448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:08.867846 24448 hybrid_clock.cc:648] HybridClock initialized: now 1786494068867796 us; error 40 us; skew 500 ppm
I20260812 00:21:08.868204 24448 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:21:08.870832 24448 webserver.cc:460] Webserver started at http://127.18.163.193:45429/ using document root <none> and password file <none>
I20260812 00:21:08.871634 24448 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:08.871768 24448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:08.872157 24448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:08.875380 24448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "a5c6c7597a1d4f67aba892e9d8c0e3ec"
format_stamp: "Formatted at 2026-08-12 00:21:08 on dist-test-slave-njxd"
server_key: "83ca545b0633cd5bd2f484f5e23e4af8"
server_key_iv: "e5ea884bb1fa8da1fa84183363ed0f6f"
server_key_version: "encryptionkey@0"
I20260812 00:21:08.876264 24448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "a5c6c7597a1d4f67aba892e9d8c0e3ec"
format_stamp: "Formatted at 2026-08-12 00:21:08 on dist-test-slave-njxd"
server_key: "83ca545b0633cd5bd2f484f5e23e4af8"
server_key_iv: "e5ea884bb1fa8da1fa84183363ed0f6f"
server_key_version: "encryptionkey@0"
I20260812 00:21:08.882233 24448 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:21:08.886024 24465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:08.887698 24448 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260812 00:21:08.887892 24448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "a5c6c7597a1d4f67aba892e9d8c0e3ec"
format_stamp: "Formatted at 2026-08-12 00:21:08 on dist-test-slave-njxd"
server_key: "83ca545b0633cd5bd2f484f5e23e4af8"
server_key_iv: "e5ea884bb1fa8da1fa84183363ed0f6f"
server_key_version: "encryptionkey@0"
I20260812 00:21:08.888151 24448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:08.894856 24448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:08.895802 24448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:08.896106 24448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:08.897179 24448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:08.898804 24448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:08.898895 24448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:08.899052 24448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:08.899154 24448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:08.935302 24448 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:44115
I20260812 00:21:08.935357 24594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:44115 every 8 connection(s)
I20260812 00:21:08.936815 24448 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:21:08.946133 24598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:08.939743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:41871 (local address 127.18.163.254:44905)
0812 00:21:08.940227 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:08.940232 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:08.941644 (+ 1412us) server_negotiation.cc:407] Connection header received
0812 00:21:08.943665 (+ 2021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:08.943682 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:08.943766 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:08.943912 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:08.945391 (+ 1479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:08.945396 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:08.945399 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:08.945424 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:08.945479 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:08.945491 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:08.945659 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:08.945840 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 00:21:08.945898 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":253,"threads_started":1}
I20260812 00:21:08.946738 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 24448
I20260812 00:21:08.946972 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:21:08.947619 19087 external_mini_cluster.cc:1428] Setting key a9e07e712c19e771f8deaedfc81460d2
I20260812 00:21:08.947885 24599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:08.940429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44905 (local address 127.18.163.193:41871)
0812 00:21:08.941440 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:08.941488 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:08.943353 (+ 1865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:08.944172 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:08.944182 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:08.944297 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:08.944995 (+ 698us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:21:08.944997 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:08.945038 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:21:08.945136 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:08.945630 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:08.945644 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:08.945655 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:21:08.945898 (+ 243us) client_negotiation.cc:240] Negotiation successful
0812 00:21:08.946124 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":319,"threads_started":1}
I20260812 00:21:08.949723 24595 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44905
I20260812 00:21:08.950080 24595 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:08.950729 24595 heartbeater.cc:511] Master 127.18.163.254:44905 requested a full tablet report, sending...
I20260812 00:21:08.951077 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44905
--builtin_ntp_servers=127.18.163.212:40033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 00:21:08.953022 24381 ts_manager.cc:194] Registered new tserver with Master: a5c6c7597a1d4f67aba892e9d8c0e3ec (127.18.163.193:44115)
W20260812 00:21:09.339076 24600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:09.339418 24600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:09.339597 24600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:09.347523 24600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:09.347689 24600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:09.347883 24600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:21:09.358366 24600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:40033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44905
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:09.359953 24600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:09.362047 24600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:09.376116 24607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:09.376156 24606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:09.376259 24609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:09.377364 24600 server_base.cc:1034] running on GCE node
I20260812 00:21:09.378157 24600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:09.379171 24600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:09.380375 24600 hybrid_clock.cc:648] HybridClock initialized: now 1786494069380329 us; error 32 us; skew 500 ppm
I20260812 00:21:09.380733 24600 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:21:09.383203 24600 webserver.cc:460] Webserver started at http://127.18.163.194:41133/ using document root <none> and password file <none>
I20260812 00:21:09.383939 24600 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:09.384039 24600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:09.384335 24600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:09.387693 24600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "d28448b20bb74f0a97012aae32439fa9"
format_stamp: "Formatted at 2026-08-12 00:21:09 on dist-test-slave-njxd"
server_key: "fc33e049e6482e3225f14b232c2126ab"
server_key_iv: "b695518c7367fdc3145a7451db47480b"
server_key_version: "encryptionkey@0"
I20260812 00:21:09.388525 24600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "d28448b20bb74f0a97012aae32439fa9"
format_stamp: "Formatted at 2026-08-12 00:21:09 on dist-test-slave-njxd"
server_key: "fc33e049e6482e3225f14b232c2126ab"
server_key_iv: "b695518c7367fdc3145a7451db47480b"
server_key_version: "encryptionkey@0"
I20260812 00:21:09.395110 24600 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260812 00:21:09.398962 24615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:09.400621 24600 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:21:09.400807 24600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "d28448b20bb74f0a97012aae32439fa9"
format_stamp: "Formatted at 2026-08-12 00:21:09 on dist-test-slave-njxd"
server_key: "fc33e049e6482e3225f14b232c2126ab"
server_key_iv: "b695518c7367fdc3145a7451db47480b"
server_key_version: "encryptionkey@0"
I20260812 00:21:09.401028 24600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:09.407225 24600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:09.408126 24600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:09.408402 24600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:09.409392 24600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:09.411234 24600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:09.411386 24600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:09.411629 24600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:09.411731 24600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:09.447570 24600 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:41487
I20260812 00:21:09.447624 24740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:41487 every 8 connection(s)
I20260812 00:21:09.449070 24600 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:21:09.451388 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 24600
I20260812 00:21:09.451612 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:21:09.452147 19087 external_mini_cluster.cc:1428] Setting key d619ca63cc6204180fdb6109060b0c81
I20260812 00:21:09.455514 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44905
--builtin_ntp_servers=127.18.163.212:40033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 00:21:09.458874 24743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:09.452207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:34819 (local address 127.18.163.254:44905)
0812 00:21:09.452732 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:09.452738 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:09.454212 (+ 1474us) server_negotiation.cc:407] Connection header received
0812 00:21:09.456253 (+ 2041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:09.456262 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:09.456338 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:09.456477 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:09.457951 (+ 1474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:09.457959 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:09.457967 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:09.457993 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:09.458053 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:09.458072 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:09.458220 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:09.458385 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 00:21:09.458462 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":259,"threads_started":1}
I20260812 00:21:09.459976 24744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:09.452953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44905 (local address 127.18.163.194:34819)
0812 00:21:09.454042 (+ 1089us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:09.454092 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:09.455942 (+ 1850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:09.456689 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:09.456698 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:09.456813 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:09.457553 (+ 740us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:21:09.457556 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:09.457656 (+ 100us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:21:09.457763 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:09.458178 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:09.458187 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:09.458192 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:21:09.458422 (+ 230us) client_negotiation.cc:240] Negotiation successful
0812 00:21:09.458760 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":341,"threads_started":1}
I20260812 00:21:09.461673 24741 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44905
I20260812 00:21:09.462018 24741 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:09.462664 24741 heartbeater.cc:511] Master 127.18.163.254:44905 requested a full tablet report, sending...
I20260812 00:21:09.464282 24381 ts_manager.cc:194] Registered new tserver with Master: d28448b20bb74f0a97012aae32439fa9 (127.18.163.194:41487)
W20260812 00:21:09.822957 24745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:09.823282 24745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:09.823380 24745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:09.831097 24745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:09.831236 24745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:09.831354 24745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:21:09.841046 24745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:40033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44905
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:09.842443 24745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:09.844339 24745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:09.858927 24757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:09.859184 24754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:09.858904 24755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:09.860512 24745 server_base.cc:1034] running on GCE node
I20260812 00:21:09.861222 24745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:09.862411 24745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:09.863683 24745 hybrid_clock.cc:648] HybridClock initialized: now 1786494069863625 us; error 55 us; skew 500 ppm
I20260812 00:21:09.864061 24745 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:21:09.866688 24745 webserver.cc:460] Webserver started at http://127.18.163.195:33331/ using document root <none> and password file <none>
I20260812 00:21:09.867493 24745 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:09.867643 24745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:09.868033 24745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:09.871460 24745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "9fde5787183540f28bf16a5cb193d840"
format_stamp: "Formatted at 2026-08-12 00:21:09 on dist-test-slave-njxd"
server_key: "8bd056ec4a39a1a894c49738f529fd07"
server_key_iv: "4fdb6e9b3a2ed7f89ee9de1cb4cd61f4"
server_key_version: "encryptionkey@0"
I20260812 00:21:09.872531 24745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "9fde5787183540f28bf16a5cb193d840"
format_stamp: "Formatted at 2026-08-12 00:21:09 on dist-test-slave-njxd"
server_key: "8bd056ec4a39a1a894c49738f529fd07"
server_key_iv: "4fdb6e9b3a2ed7f89ee9de1cb4cd61f4"
server_key_version: "encryptionkey@0"
I20260812 00:21:09.879037 24745 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 00:21:09.883394 24765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:09.885128 24745 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:21:09.885437 24745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "9fde5787183540f28bf16a5cb193d840"
format_stamp: "Formatted at 2026-08-12 00:21:09 on dist-test-slave-njxd"
server_key: "8bd056ec4a39a1a894c49738f529fd07"
server_key_iv: "4fdb6e9b3a2ed7f89ee9de1cb4cd61f4"
server_key_version: "encryptionkey@0"
I20260812 00:21:09.885779 24745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:09.892370 24745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:09.893482 24745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:09.893860 24745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:09.894991 24745 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:09.896669 24745 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:09.896809 24745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:09.896960 24745 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:09.897054 24745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:09.933887 24745 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:34469
I20260812 00:21:09.933943 24894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:34469 every 8 connection(s)
I20260812 00:21:09.935796 24745 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:21:09.945063 24743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:09.938829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:50171 (local address 127.18.163.254:44905)
0812 00:21:09.939085 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:09.939092 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:09.940778 (+ 1686us) server_negotiation.cc:407] Connection header received
0812 00:21:09.942710 (+ 1932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:09.942715 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:09.942777 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:09.942874 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:09.944290 (+ 1416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:09.944294 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:09.944298 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:09.944316 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:09.944352 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:09.944365 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:09.944471 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:09.944649 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 00:21:09.944708 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260812 00:21:09.945263 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 24745
I20260812 00:21:09.945466 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:21:09.945988 19087 external_mini_cluster.cc:1428] Setting key a1fa7cc660138b82beeebd12df03d72d
I20260812 00:21:09.946331 24897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:09.939369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44905 (local address 127.18.163.195:50171)
0812 00:21:09.940571 (+ 1202us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:09.940633 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:09.942427 (+ 1794us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:09.943106 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:09.943116 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:09.943231 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:09.943938 (+ 707us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:21:09.943941 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:09.943985 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:21:09.944082 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:09.944457 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:09.944465 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:09.944472 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 00:21:09.944707 (+ 235us) client_negotiation.cc:240] Negotiation successful
0812 00:21:09.944948 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":329,"threads_started":1}
I20260812 00:21:09.948119 24895 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44905
I20260812 00:21:09.948477 24895 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:09.949133 24895 heartbeater.cc:511] Master 127.18.163.254:44905 requested a full tablet report, sending...
I20260812 00:21:09.950737 24381 ts_manager.cc:194] Registered new tserver with Master: 9fde5787183540f28bf16a5cb193d840 (127.18.163.195:34469)
I20260812 00:21:09.956146 24595 heartbeater.cc:503] Master 127.18.163.254:44905 was elected leader, sending a full tablet report...
I20260812 00:21:09.962524 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:21:09.970571 24743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:09.967644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39346 (local address 127.18.163.254:44905)
0812 00:21:09.967858 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:09.967867 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:09.968384 (+ 517us) server_negotiation.cc:407] Connection header received
0812 00:21:09.968607 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:09.968618 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:09.968675 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:09.968796 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:09.969871 (+ 1075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:09.969876 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:09.969879 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:09.969899 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:09.969936 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:09.969949 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:09.970099 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:09.970184 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 00:21:09.970260 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 00:21:09.975229 24381 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39346:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:21:09.982810 24381 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:21:10.008929 24909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:09.996817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:44115 (local address 127.0.0.1:58282)
0812 00:21:10.004225 (+ 7408us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:10.004305 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:10.004528 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:10.006208 (+ 1680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:10.006217 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:10.006329 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:10.007396 (+ 1067us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:21:10.007402 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:10.007438 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:21:10.007540 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:10.008078 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:10.008092 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:10.008099 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 00:21:10.008270 (+ 171us) client_negotiation.cc:240] Negotiation successful
0812 00:21:10.008366 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6984,"thread_start_us":6675,"threads_started":1}
I20260812 00:21:10.010284 24913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:09.997086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58282 (local address 127.18.163.193:44115)
0812 00:21:10.005627 (+ 8541us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:10.005638 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:10.005677 (+ 39us) server_negotiation.cc:407] Connection header received
0812 00:21:10.005744 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:10.005750 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:10.005947 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:10.006140 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:10.007805 (+ 1665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:10.007816 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:10.007832 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:10.007854 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:10.007929 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:10.007953 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:10.009640 (+ 1687us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:10.009731 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 00:21:10.009847 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8323,"thread_start_us":8156,"threads_started":1}
I20260812 00:21:10.010720 24915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:09.997056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:34469 (local address 127.0.0.1:43842)
0812 00:21:10.006342 (+ 9286us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:10.006369 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:10.006648 (+ 279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:10.008377 (+ 1729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:10.008384 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:10.008417 (+ 33us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:10.009455 (+ 1038us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:21:10.009459 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:10.009479 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:21:10.009531 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:10.009999 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:10.010004 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:10.010008 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:21:10.010146 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 00:21:10.010201 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9120,"thread_start_us":10525,"threads_started":1}
I20260812 00:21:10.010990 24911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:09.998223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:41487 (local address 127.0.0.1:56548)
0812 00:21:10.007866 (+ 9643us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:10.007885 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:10.007986 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:10.008985 (+ 999us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:10.008991 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:10.009019 (+ 28us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:10.009692 (+ 673us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:21:10.009696 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:10.009711 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:21:10.009757 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:10.010260 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:10.010264 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:10.010269 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:21:10.010407 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 00:21:10.010454 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9511,"thread_start_us":7788,"threads_started":1}
I20260812 00:21:10.011622 24916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:09.998951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56548 (local address 127.18.163.194:41487)
0812 00:21:10.005837 (+ 6886us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:10.005849 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:10.008114 (+ 2265us) server_negotiation.cc:407] Connection header received
0812 00:21:10.008198 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:10.008219 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:10.008435 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:10.008584 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:10.009922 (+ 1338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:10.009931 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:10.009946 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:10.009969 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:10.010039 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:10.010072 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:10.010201 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:10.011197 (+ 996us) server_negotiation.cc:299] Negotiation successful
0812 00:21:10.011304 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6698,"thread_start_us":6524,"threads_started":1}
I20260812 00:21:10.013327 24914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:09.997482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43842 (local address 127.18.163.195:34469)
0812 00:21:10.005174 (+ 7692us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:10.005188 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:10.006520 (+ 1332us) server_negotiation.cc:407] Connection header received
0812 00:21:10.007278 (+ 758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:10.007296 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:10.007612 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:10.007781 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:10.009763 (+ 1982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:10.009771 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:10.009784 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:10.009803 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:10.009871 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:10.009892 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:10.010074 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:10.010149 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 00:21:10.012930 (+ 2781us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7431,"thread_start_us":7234,"threads_started":1}
I20260812 00:21:10.015051 24520 tablet_service.cc:1467] Processing CreateTablet for tablet 1dba51dbc0ec42008ea2b782c2ebca7e (DEFAULT_TABLE table=test-table [id=20798a2d780c4185a6b5877ae212b32a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:10.015259 24669 tablet_service.cc:1467] Processing CreateTablet for tablet 1dba51dbc0ec42008ea2b782c2ebca7e (DEFAULT_TABLE table=test-table [id=20798a2d780c4185a6b5877ae212b32a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:10.016664 24520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dba51dbc0ec42008ea2b782c2ebca7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:10.016673 24669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dba51dbc0ec42008ea2b782c2ebca7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:10.018503 24820 tablet_service.cc:1467] Processing CreateTablet for tablet 1dba51dbc0ec42008ea2b782c2ebca7e (DEFAULT_TABLE table=test-table [id=20798a2d780c4185a6b5877ae212b32a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:10.020054 24820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dba51dbc0ec42008ea2b782c2ebca7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:10.029408 24917 tablet_bootstrap.cc:492] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec: Bootstrap starting.
I20260812 00:21:10.033593 24918 tablet_bootstrap.cc:492] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9: Bootstrap starting.
I20260812 00:21:10.033861 24917 tablet_bootstrap.cc:654] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:10.035441 24917 log.cc:824] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:10.036212 24919 tablet_bootstrap.cc:492] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840: Bootstrap starting.
I20260812 00:21:10.038007 24918 tablet_bootstrap.cc:654] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:10.039407 24918 log.cc:824] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:10.040131 24919 tablet_bootstrap.cc:654] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:10.041193 24917 tablet_bootstrap.cc:492] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec: No bootstrap required, opened a new log
I20260812 00:21:10.041340 24919 log.cc:824] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:10.041648 24917 ts_tablet_manager.cc:1397] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.006s
I20260812 00:21:10.044636 24918 tablet_bootstrap.cc:492] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9: No bootstrap required, opened a new log
I20260812 00:21:10.044934 24918 ts_tablet_manager.cc:1397] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20260812 00:21:10.046842 24919 tablet_bootstrap.cc:492] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840: No bootstrap required, opened a new log
I20260812 00:21:10.047128 24919 ts_tablet_manager.cc:1397] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.003s
I20260812 00:21:10.052953 24917 raft_consensus.cc:348] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c6c7597a1d4f67aba892e9d8c0e3ec" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 44115 } } peers { permanent_uuid: "9fde5787183540f28bf16a5cb193d840" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 34469 } } peers { permanent_uuid: "d28448b20bb74f0a97012aae32439fa9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41487 } }
I20260812 00:21:10.053508 24917 raft_consensus.cc:374] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:10.053648 24917 raft_consensus.cc:729] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5c6c7597a1d4f67aba892e9d8c0e3ec, State: Initialized, Role: FOLLOWER
I20260812 00:21:10.054392 24917 consensus_queue.cc:260] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c6c7597a1d4f67aba892e9d8c0e3ec" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 44115 } } peers { permanent_uuid: "9fde5787183540f28bf16a5cb193d840" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 34469 } } peers { permanent_uuid: "d28448b20bb74f0a97012aae32439fa9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41487 } }
I20260812 00:21:10.055980 24919 raft_consensus.cc:348] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c6c7597a1d4f67aba892e9d8c0e3ec" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 44115 } } peers { permanent_uuid: "9fde5787183540f28bf16a5cb193d840" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 34469 } } peers { permanent_uuid: "d28448b20bb74f0a97012aae32439fa9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41487 } }
I20260812 00:21:10.056404 24919 raft_consensus.cc:374] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:10.056530 24919 raft_consensus.cc:729] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fde5787183540f28bf16a5cb193d840, State: Initialized, Role: FOLLOWER
I20260812 00:21:10.057231 24918 raft_consensus.cc:348] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c6c7597a1d4f67aba892e9d8c0e3ec" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 44115 } } peers { permanent_uuid: "9fde5787183540f28bf16a5cb193d840" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 34469 } } peers { permanent_uuid: "d28448b20bb74f0a97012aae32439fa9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41487 } }
I20260812 00:21:10.057413 24919 consensus_queue.cc:260] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c6c7597a1d4f67aba892e9d8c0e3ec" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 44115 } } peers { permanent_uuid: "9fde5787183540f28bf16a5cb193d840" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 34469 } } peers { permanent_uuid: "d28448b20bb74f0a97012aae32439fa9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41487 } }
I20260812 00:21:10.057753 24918 raft_consensus.cc:374] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:10.057857 24918 raft_consensus.cc:729] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28448b20bb74f0a97012aae32439fa9, State: Initialized, Role: FOLLOWER
I20260812 00:21:10.058130 24917 ts_tablet_manager.cc:1428] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec: Time spent starting tablet: real 0.016s user 0.013s sys 0.003s
I20260812 00:21:10.058681 24918 consensus_queue.cc:260] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c6c7597a1d4f67aba892e9d8c0e3ec" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 44115 } } peers { permanent_uuid: "9fde5787183540f28bf16a5cb193d840" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 34469 } } peers { permanent_uuid: "d28448b20bb74f0a97012aae32439fa9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41487 } }
I20260812 00:21:10.059471 24895 heartbeater.cc:503] Master 127.18.163.254:44905 was elected leader, sending a full tablet report...
I20260812 00:21:10.060261 24919 ts_tablet_manager.cc:1428] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260812 00:21:10.061339 24741 heartbeater.cc:503] Master 127.18.163.254:44905 was elected leader, sending a full tablet report...
I20260812 00:21:10.062103 24918 ts_tablet_manager.cc:1428] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9: Time spent starting tablet: real 0.017s user 0.012s sys 0.004s
W20260812 00:21:10.187747 24896 tablet.cc:2369] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:21:10.190078 24596 tablet.cc:2369] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:21:10.201514 24742 tablet.cc:2369] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:21:10.238554 24925 raft_consensus.cc:482] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:21:10.238935 24925 raft_consensus.cc:504] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c6c7597a1d4f67aba892e9d8c0e3ec" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 44115 } } peers { permanent_uuid: "9fde5787183540f28bf16a5cb193d840" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 34469 } } peers { permanent_uuid: "d28448b20bb74f0a97012aae32439fa9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41487 } }
I20260812 00:21:10.240756 24925 leader_election.cc:288] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5c6c7597a1d4f67aba892e9d8c0e3ec (127.18.163.193:44115), 9fde5787183540f28bf16a5cb193d840 (127.18.163.195:34469)
I20260812 00:21:10.244513 24914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:10.241420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:56151 (local address 127.18.163.195:34469)
0812 00:21:10.241683 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:10.241691 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:10.242308 (+ 617us) server_negotiation.cc:407] Connection header received
0812 00:21:10.242419 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:10.242425 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:10.242490 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:10.242599 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:10.243861 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:10.243867 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:10.243872 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:10.243893 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:10.243933 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:10.243949 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:10.244087 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:10.244186 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 00:21:10.244245 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260812 00:21:10.244511 24913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:10.241390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:41223 (local address 127.18.163.193:44115)
0812 00:21:10.241671 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:10.241681 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:10.242220 (+ 539us) server_negotiation.cc:407] Connection header received
0812 00:21:10.242420 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:10.242425 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:10.242490 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:10.242599 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:10.243861 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:10.243867 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:10.243872 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:10.243893 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:10.243933 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:10.243949 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:10.244087 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:10.244175 (+ 88us) server_negotiation.cc:299] Negotiation successful
0812 00:21:10.244245 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 00:21:10.244875 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:10.241140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:44115 (local address 127.18.163.194:41223)
0812 00:21:10.242082 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:10.242106 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:10.242270 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:10.242651 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:10.242657 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:10.242684 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:10.243623 (+ 939us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:21:10.243625 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:10.243636 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:21:10.243678 (+ 42us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:10.244059 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:10.244064 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:10.244070 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:21:10.244280 (+ 210us) client_negotiation.cc:240] Negotiation successful
0812 00:21:10.244376 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":773,"mutex_wait_us":22,"thread_start_us":539,"threads_started":1}
I20260812 00:21:10.245236 24927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:10.241240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:34469 (local address 127.18.163.194:56151)
0812 00:21:10.242188 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:10.242204 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:10.242300 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:10.242651 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:10.242657 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:10.242684 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:10.243604 (+ 920us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:21:10.243608 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:10.243627 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:21:10.243678 (+ 51us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:10.244059 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:10.244064 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:10.244070 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:21:10.244280 (+ 210us) client_negotiation.cc:240] Negotiation successful
0812 00:21:10.244353 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":826,"thread_start_us":609,"threads_started":1}
I20260812 00:21:10.246320 24845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dba51dbc0ec42008ea2b782c2ebca7e" candidate_uuid: "d28448b20bb74f0a97012aae32439fa9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fde5787183540f28bf16a5cb193d840" is_pre_election: true
I20260812 00:21:10.246291 24543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dba51dbc0ec42008ea2b782c2ebca7e" candidate_uuid: "d28448b20bb74f0a97012aae32439fa9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c6c7597a1d4f67aba892e9d8c0e3ec" is_pre_election: true
I20260812 00:21:10.246937 24543 raft_consensus.cc:2454] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28448b20bb74f0a97012aae32439fa9 in term 0.
I20260812 00:21:10.246937 24845 raft_consensus.cc:2454] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d28448b20bb74f0a97012aae32439fa9 in term 0.
I20260812 00:21:10.247696 24618 leader_election.cc:302] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fde5787183540f28bf16a5cb193d840, d28448b20bb74f0a97012aae32439fa9; no voters:
I20260812 00:21:10.248070 24925 raft_consensus.cc:2781] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:21:10.248240 24925 raft_consensus.cc:482] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:21:10.248359 24925 raft_consensus.cc:3037] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:10.251022 24925 raft_consensus.cc:504] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c6c7597a1d4f67aba892e9d8c0e3ec" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 44115 } } peers { permanent_uuid: "9fde5787183540f28bf16a5cb193d840" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 34469 } } peers { permanent_uuid: "d28448b20bb74f0a97012aae32439fa9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41487 } }
I20260812 00:21:10.251721 24925 leader_election.cc:288] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [CANDIDATE]: Term 1 election: Requested vote from peers a5c6c7597a1d4f67aba892e9d8c0e3ec (127.18.163.193:44115), 9fde5787183540f28bf16a5cb193d840 (127.18.163.195:34469)
I20260812 00:21:10.252295 24543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dba51dbc0ec42008ea2b782c2ebca7e" candidate_uuid: "d28448b20bb74f0a97012aae32439fa9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c6c7597a1d4f67aba892e9d8c0e3ec"
I20260812 00:21:10.252295 24845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dba51dbc0ec42008ea2b782c2ebca7e" candidate_uuid: "d28448b20bb74f0a97012aae32439fa9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fde5787183540f28bf16a5cb193d840"
I20260812 00:21:10.252544 24845 raft_consensus.cc:3037] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:10.252544 24543 raft_consensus.cc:3037] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:10.256129 24543 raft_consensus.cc:2454] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28448b20bb74f0a97012aae32439fa9 in term 1.
I20260812 00:21:10.256129 24845 raft_consensus.cc:2454] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d28448b20bb74f0a97012aae32439fa9 in term 1.
I20260812 00:21:10.256718 24618 leader_election.cc:302] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 9fde5787183540f28bf16a5cb193d840, a5c6c7597a1d4f67aba892e9d8c0e3ec, d28448b20bb74f0a97012aae32439fa9; no voters:
I20260812 00:21:10.257087 24925 raft_consensus.cc:2781] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:10.257673 24925 raft_consensus.cc:686] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [term 1 LEADER]: Becoming Leader. State: Replica: d28448b20bb74f0a97012aae32439fa9, State: Running, Role: LEADER
I20260812 00:21:10.258293 24925 consensus_queue.cc:237] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c6c7597a1d4f67aba892e9d8c0e3ec" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 44115 } } peers { permanent_uuid: "9fde5787183540f28bf16a5cb193d840" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 34469 } } peers { permanent_uuid: "d28448b20bb74f0a97012aae32439fa9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41487 } }
I20260812 00:21:10.263458 24382 catalog_manager.cc:5495] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d28448b20bb74f0a97012aae32439fa9 (127.18.163.194). New cstate: current_term: 1 leader_uuid: "d28448b20bb74f0a97012aae32439fa9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c6c7597a1d4f67aba892e9d8c0e3ec" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fde5787183540f28bf16a5cb193d840" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 34469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28448b20bb74f0a97012aae32439fa9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41487 } health_report { overall_health: HEALTHY } } }
I20260812 00:21:10.317620 24916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:10.315022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56560 (local address 127.18.163.194:41487)
0812 00:21:10.315257 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:10.315264 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:10.315392 (+ 128us) server_negotiation.cc:407] Connection header received
0812 00:21:10.315670 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:10.315675 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:10.315766 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:10.315887 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:10.316903 (+ 1016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:10.316908 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:10.316912 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:10.316929 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:10.316962 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:10.316974 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:10.317118 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:10.317211 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 00:21:10.317280 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 00:21:10.327100 24543 raft_consensus.cc:1261] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec [term 1 FOLLOWER]: Refusing update from remote peer d28448b20bb74f0a97012aae32439fa9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:10.327098 24845 raft_consensus.cc:1261] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840 [term 1 FOLLOWER]: Refusing update from remote peer d28448b20bb74f0a97012aae32439fa9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:10.328166 24928 consensus_queue.cc:1035] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c6c7597a1d4f67aba892e9d8c0e3ec" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:10.328603 24925 consensus_queue.cc:1035] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fde5787183540f28bf16a5cb193d840" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:10.342006 24931 mvcc.cc:205] Tried to move back new op lower bound from 7317479712048304128 to 7317479711782383616. Current Snapshot: MvccSnapshot[applied={T|T < 7317479712048304128}]
I20260812 00:21:10.347523 24933 mvcc.cc:205] Tried to move back new op lower bound from 7317479712048304128 to 7317479711782383616. Current Snapshot: MvccSnapshot[applied={T|T < 7317479712048304128}]
I20260812 00:21:10.354414 24932 mvcc.cc:205] Tried to move back new op lower bound from 7317479712048304128 to 7317479711782383616. Current Snapshot: MvccSnapshot[applied={T|T < 7317479712048304128 or (T in {7317479712048304128})}]
I20260812 00:21:10.361474 24382 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:21:10.361869 24382 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:21:10.366386 24382 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ab46c34653e640028dcf3f20fc365763: Sending DeleteTablet for 3 replicas of tablet 1dba51dbc0ec42008ea2b782c2ebca7e
I20260812 00:21:10.367770 24520 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dba51dbc0ec42008ea2b782c2ebca7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:10 UTC) from {username='slave'} at 127.0.0.1:58282
I20260812 00:21:10.367815 24820 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dba51dbc0ec42008ea2b782c2ebca7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:10 UTC) from {username='slave'} at 127.0.0.1:43842
I20260812 00:21:10.368057 24669 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dba51dbc0ec42008ea2b782c2ebca7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:10 UTC) from {username='slave'} at 127.0.0.1:56548
I20260812 00:21:10.370280 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 24448
I20260812 00:21:10.380585 24940 tablet_replica.cc:330] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec: stopping tablet replica
I20260812 00:21:10.381422 24940 raft_consensus.cc:2229] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:10.382309 24940 raft_consensus.cc:2258] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:10.384030 24942 tablet_replica.cc:330] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9: stopping tablet replica
I20260812 00:21:10.384652 24942 raft_consensus.cc:2229] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:21:10.385460 24942 raft_consensus.cc:2258] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:10.386276 24940 ts_tablet_manager.cc:1905] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:10.388157 24942 ts_tablet_manager.cc:1905] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:10.394312 24940 ts_tablet_manager.cc:1918] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:10.394553 24940 log.cc:1196] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/1dba51dbc0ec42008ea2b782c2ebca7e
I20260812 00:21:10.395144 24940 ts_tablet_manager.cc:1939] T 1dba51dbc0ec42008ea2b782c2ebca7e P a5c6c7597a1d4f67aba892e9d8c0e3ec: Deleting consensus metadata
I20260812 00:21:10.396565 24913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:10.372360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58288 (local address 127.18.163.193:44115)
0812 00:21:10.372587 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:10.372593 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:10.393699 (+ 21106us) server_negotiation.cc:407] Connection header received
0812 00:21:10.393970 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:10.393977 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:10.394113 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:10.394243 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:10.395618 (+ 1375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:10.395637 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:10.395643 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:10.395667 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:10.395709 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:10.395726 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:10.395851 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:10.396144 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 00:21:10.396231 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 00:21:10.397279 24364 catalog_manager.cc:4841] TS a5c6c7597a1d4f67aba892e9d8c0e3ec (127.18.163.193:44115): tablet 1dba51dbc0ec42008ea2b782c2ebca7e (table test-table [id=20798a2d780c4185a6b5877ae212b32a]) successfully deleted
I20260812 00:21:10.397787 24941 tablet_replica.cc:330] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840: stopping tablet replica
I20260812 00:21:10.397799 24590 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:10.398293 24941 raft_consensus.cc:2229] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:10.398865 24941 raft_consensus.cc:2258] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:10.399214 24942 ts_tablet_manager.cc:1918] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:10.400614 24942 log.cc:1196] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/1dba51dbc0ec42008ea2b782c2ebca7e
I20260812 00:21:10.401974 24942 ts_tablet_manager.cc:1939] T 1dba51dbc0ec42008ea2b782c2ebca7e P d28448b20bb74f0a97012aae32439fa9: Deleting consensus metadata
I20260812 00:21:10.403426 24941 ts_tablet_manager.cc:1905] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:10.411808 24941 ts_tablet_manager.cc:1918] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:10.411947 24367 catalog_manager.cc:4841] TS d28448b20bb74f0a97012aae32439fa9 (127.18.163.194:41487): tablet 1dba51dbc0ec42008ea2b782c2ebca7e (table test-table [id=20798a2d780c4185a6b5877ae212b32a]) successfully deleted
I20260812 00:21:10.412034 24941 log.cc:1196] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/1dba51dbc0ec42008ea2b782c2ebca7e
I20260812 00:21:10.412724 24941 ts_tablet_manager.cc:1939] T 1dba51dbc0ec42008ea2b782c2ebca7e P 9fde5787183540f28bf16a5cb193d840: Deleting consensus metadata
I20260812 00:21:10.415277 24366 catalog_manager.cc:4841] TS 9fde5787183540f28bf16a5cb193d840 (127.18.163.195:34469): tablet 1dba51dbc0ec42008ea2b782c2ebca7e (table test-table [id=20798a2d780c4185a6b5877ae212b32a]) successfully deleted
I20260812 00:21:10.513520 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 24448
I20260812 00:21:10.539150 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 24600
I20260812 00:21:10.542490 24916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:10.540229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56570 (local address 127.18.163.194:41487)
0812 00:21:10.540411 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:10.540415 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:10.540436 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:21:10.540513 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:10.540516 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:10.540579 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:10.540663 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:10.541770 (+ 1107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:10.541774 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:10.541777 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:10.541795 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:10.541829 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:10.541841 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:10.541956 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:10.542106 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 00:21:10.542159 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 00:21:10.543251 24736 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:10.664124 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 24600
I20260812 00:21:10.688760 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 24745
I20260812 00:21:10.692071 24914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:10.689680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43846 (local address 127.18.163.195:34469)
0812 00:21:10.689868 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:10.689877 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:10.689968 (+ 91us) server_negotiation.cc:407] Connection header received
0812 00:21:10.690204 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:10.690209 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:10.690292 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:10.690406 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:10.691383 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:10.691393 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:10.691396 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:10.691413 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:10.691446 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:10.691458 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:10.691600 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:10.691703 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 00:21:10.691770 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 00:21:10.692772 24890 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:10.785334 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 24745
I20260812 00:21:10.809526 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 24343
I20260812 00:21:10.810906 24413 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:10.923569 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 24343
2026-08-12T00:21:10Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (3130 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 00:21:10.972275 19087 mini_oidc.cc:152] Starting JWKS server
I20260812 00:21:10.975339 19087 webserver.cc:460] Webserver started at https://127.0.0.1:34369/ using document root <none> and password file <none>
I20260812 00:21:10.975630 19087 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 00:21:10.976300 19087 webserver.cc:460] Webserver started at http://127.0.0.1:33451/ using document root <none> and password file <none>
2026-08-12T00:21:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:21:10Z Disabled control of system clock
I20260812 00:21:11.018472 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:35981
--webserver_interface=127.18.163.254
--webserver_port=0
--builtin_ntp_servers=127.18.163.212:37271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:35981
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34369/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/testchainca.cert with env {}
W20260812 00:21:11.370980 24956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:11.371304 24956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:11.371491 24956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:11.379413 24956 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:21:11.379542 24956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:11.379634 24956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:11.379748 24956 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:21:11.379840 24956 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:21:11.379957 24956 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:21:11.380035 24956 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34369/jwks.json
I20260812 00:21:11.390702 24956 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:37271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:35981
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:35981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34369/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:11.392174 24956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:11.393750 24956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:11.406440 24962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:11.406502 24961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:11.406504 24964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:11.407581 24956 server_base.cc:1034] running on GCE node
I20260812 00:21:11.408354 24956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:11.409824 24956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:11.411037 24956 hybrid_clock.cc:648] HybridClock initialized: now 1786494071410998 us; error 25 us; skew 500 ppm
I20260812 00:21:11.411372 24956 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:21:11.413771 24956 webserver.cc:460] Webserver started at http://127.18.163.254:41721/ using document root <none> and password file <none>
I20260812 00:21:11.414522 24956 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:11.414662 24956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:11.415004 24956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:11.418109 24956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "89ef4b9ffa2b49a7a7726a22db5a409e"
format_stamp: "Formatted at 2026-08-12 00:21:11 on dist-test-slave-njxd"
server_key: "6409bf1a8afd7b912c661fe49c0f531d"
server_key_iv: "7daf1e822da756f2a8a725941e46d92d"
server_key_version: "encryptionkey@0"
I20260812 00:21:11.418967 24956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "89ef4b9ffa2b49a7a7726a22db5a409e"
format_stamp: "Formatted at 2026-08-12 00:21:11 on dist-test-slave-njxd"
server_key: "6409bf1a8afd7b912c661fe49c0f531d"
server_key_iv: "7daf1e822da756f2a8a725941e46d92d"
server_key_version: "encryptionkey@0"
I20260812 00:21:11.424435 24956 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 00:21:11.428090 24973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:11.429529 24956 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:21:11.429773 24956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "89ef4b9ffa2b49a7a7726a22db5a409e"
format_stamp: "Formatted at 2026-08-12 00:21:11 on dist-test-slave-njxd"
server_key: "6409bf1a8afd7b912c661fe49c0f531d"
server_key_iv: "7daf1e822da756f2a8a725941e46d92d"
server_key_version: "encryptionkey@0"
I20260812 00:21:11.430018 24956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:11.444486 24956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:11.445410 24956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:11.445784 24956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:11.465488 24956 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:35981
I20260812 00:21:11.465495 25032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:35981 every 8 connection(s)
I20260812 00:21:11.467031 24956 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:21:11.471094 25033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:11.475538 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 24956
I20260812 00:21:11.475768 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:21:11.476634 19087 external_mini_cluster.cc:1428] Setting key 4e239530a0d751bb064c35ceb6257937
I20260812 00:21:11.484292 25033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e: Bootstrap starting.
I20260812 00:21:11.488389 25033 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:11.489543 25033 log.cc:824] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:11.492620 25036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:11.478853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58050 (local address 127.18.163.254:35981)
0812 00:21:11.479937 (+ 1084us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:11.479949 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:11.479996 (+ 47us) server_negotiation.cc:407] Connection header received
0812 00:21:11.482504 (+ 2508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:11.482532 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:11.483076 (+ 544us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:11.483433 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:11.484215 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:11.485714 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:11.487763 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:11.488492 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:11.488744 (+ 252us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:11.490099 (+ 1355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:11.490107 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:11.490123 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:11.490755 (+ 632us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:11.490853 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:11.490875 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:11.491026 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:11.491250 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 00:21:11.491605 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":634,"thread_start_us":395,"threads_started":1}
I20260812 00:21:11.492986 25033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e: No bootstrap required, opened a new log
I20260812 00:21:11.496930 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:21:11.502089 25033 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89ef4b9ffa2b49a7a7726a22db5a409e" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35981 } }
I20260812 00:21:11.502547 25033 raft_consensus.cc:374] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:11.502677 25033 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ef4b9ffa2b49a7a7726a22db5a409e, State: Initialized, Role: FOLLOWER
I20260812 00:21:11.503291 25033 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89ef4b9ffa2b49a7a7726a22db5a409e" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35981 } }
I20260812 00:21:11.503556 25033 raft_consensus.cc:388] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:21:11.503717 25033 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:21:11.503906 25033 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:11.506680 25033 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89ef4b9ffa2b49a7a7726a22db5a409e" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35981 } }
I20260812 00:21:11.507368 25033 leader_election.cc:302] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 89ef4b9ffa2b49a7a7726a22db5a409e; no voters:
I20260812 00:21:11.508008 25033 leader_election.cc:288] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:21:11.508178 25038 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:11.509003 25038 raft_consensus.cc:686] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [term 1 LEADER]: Becoming Leader. State: Replica: 89ef4b9ffa2b49a7a7726a22db5a409e, State: Running, Role: LEADER
I20260812 00:21:11.509541 25038 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89ef4b9ffa2b49a7a7726a22db5a409e" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35981 } }
I20260812 00:21:11.510460 25033 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:21:11.512763 25040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89ef4b9ffa2b49a7a7726a22db5a409e. Latest consensus state: current_term: 1 leader_uuid: "89ef4b9ffa2b49a7a7726a22db5a409e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89ef4b9ffa2b49a7a7726a22db5a409e" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35981 } } }
I20260812 00:21:11.513276 25040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:11.517941 25039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "89ef4b9ffa2b49a7a7726a22db5a409e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89ef4b9ffa2b49a7a7726a22db5a409e" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35981 } } }
I20260812 00:21:11.518440 25039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:11.520433 25045 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:21:11.527587 25045 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:21:11.537819 25045 catalog_manager.cc:1347] Generated new cluster ID: e169910344e04e279ad79c9bee27f87a
I20260812 00:21:11.537961 25045 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:21:11.570564 25045 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:21:11.572616 25045 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:21:11.582777 25045 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 89ef4b9ffa2b49a7a7726a22db5a409e: Generated new TSK 0
I20260812 00:21:11.584051 25045 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 00:21:11.647303 25065 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 00:21:11.647552 25065 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 00:21:11.648381 25036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:11.618035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58052 (local address 127.18.163.254:35981)
0812 00:21:11.618310 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:11.618317 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:11.618769 (+ 452us) server_negotiation.cc:407] Connection header received
0812 00:21:11.619204 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:11.619209 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:11.619284 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:11.619418 (+ 134us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:21:11.620127 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:11.620890 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:11.623229 (+ 2339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:11.623770 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:11.623884 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:11.624628 (+ 744us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:21:11.647820 (+ 23192us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34369/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 00:21:11.648146 (+ 326us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58052: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34369/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":78}
W20260812 00:21:11.648558 25036 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58052: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34369/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260812 00:21:11.650635 25064 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:11.617920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35981 (local address 127.0.0.1:58052)
0812 00:21:11.618633 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:11.618669 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:11.618881 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:11.619484 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:11.619490 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:11.619505 (+ 15us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:21:11.619958 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:11.619971 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:11.621073 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:11.621079 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:11.623041 (+ 1962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:11.623058 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:11.623980 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:11.623987 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:11.624198 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:11.624288 (+ 90us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:21:11.648159 (+ 23871us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34369/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 00:21:11.648577 (+ 418us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.163.254:35981: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34369/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":346,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.18.163.254:35981: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34369/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 00:21:11.653010 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 24956
I20260812 00:21:11.654323 25028 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:11.754464 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 24956
2026-08-12T00:21:11Z chronyd exiting
I20260812 00:21:11.811033 19087 test_util.cc:175] -----------------------------------------------
I20260812 00:21:11.811184 19087 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494024564100-19087-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (843 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 00:21:11.815169 19087 mini_oidc.cc:152] Starting JWKS server
I20260812 00:21:11.817107 19087 webserver.cc:460] Webserver started at https://127.0.0.1:39305/ using document root <none> and password file <none>
I20260812 00:21:11.817344 19087 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 00:21:11.818089 19087 webserver.cc:460] Webserver started at http://127.0.0.1:34893/ using document root <none> and password file <none>
2026-08-12T00:21:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:21:11Z Disabled control of system clock
I20260812 00:21:11.860095 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44899
--webserver_interface=127.18.163.254
--webserver_port=0
--builtin_ntp_servers=127.18.163.212:38439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:44899
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39305/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/testchainca.cert with env {}
W20260812 00:21:12.215363 25072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:12.215761 25072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:12.215938 25072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:12.223717 25072 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:21:12.223896 25072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:12.223999 25072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:12.224125 25072 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:21:12.224215 25072 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:21:12.224310 25072 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:21:12.224395 25072 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39305/jwks.json
I20260812 00:21:12.234906 25072 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:38439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:44899
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39305/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:12.236431 25072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:12.237941 25072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:12.251283 25077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:12.251214 25078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:12.251232 25080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:12.252113 25072 server_base.cc:1034] running on GCE node
I20260812 00:21:12.253050 25072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:12.254837 25072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:12.256081 25072 hybrid_clock.cc:648] HybridClock initialized: now 1786494072256016 us; error 64 us; skew 500 ppm
I20260812 00:21:12.256475 25072 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:21:12.259013 25072 webserver.cc:460] Webserver started at http://127.18.163.254:36409/ using document root <none> and password file <none>
I20260812 00:21:12.259812 25072 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:12.259968 25072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:12.260339 25072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:12.265228 25072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "2a76a486c1664f7a88d5aed4c1bcd0d6"
format_stamp: "Formatted at 2026-08-12 00:21:12 on dist-test-slave-njxd"
server_key: "5babd9c87b87bdf20ce472be534d7018"
server_key_iv: "559f5e0cc901ddfb4372cd4c9a96ce7e"
server_key_version: "encryptionkey@0"
I20260812 00:21:12.266530 25072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "2a76a486c1664f7a88d5aed4c1bcd0d6"
format_stamp: "Formatted at 2026-08-12 00:21:12 on dist-test-slave-njxd"
server_key: "5babd9c87b87bdf20ce472be534d7018"
server_key_iv: "559f5e0cc901ddfb4372cd4c9a96ce7e"
server_key_version: "encryptionkey@0"
I20260812 00:21:12.273818 25072 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.005s
I20260812 00:21:12.277623 25087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:12.279238 25072 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:21:12.279443 25072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "2a76a486c1664f7a88d5aed4c1bcd0d6"
format_stamp: "Formatted at 2026-08-12 00:21:12 on dist-test-slave-njxd"
server_key: "5babd9c87b87bdf20ce472be534d7018"
server_key_iv: "559f5e0cc901ddfb4372cd4c9a96ce7e"
server_key_version: "encryptionkey@0"
I20260812 00:21:12.279695 25072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:12.309167 25072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:12.310223 25072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:12.310559 25072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:12.330385 25072 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:44899
I20260812 00:21:12.330407 25144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:44899 every 8 connection(s)
I20260812 00:21:12.331933 25072 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:21:12.336030 25145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:12.338135 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 25072
I20260812 00:21:12.338393 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:21:12.339227 19087 external_mini_cluster.cc:1428] Setting key 7181f3e251ad97d826ce589479675a32
I20260812 00:21:12.350265 25145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6: Bootstrap starting.
I20260812 00:21:12.354586 25145 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:12.354853 25148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:12.341496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34912 (local address 127.18.163.254:44899)
0812 00:21:12.342790 (+ 1294us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:12.342805 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:12.342854 (+ 49us) server_negotiation.cc:407] Connection header received
0812 00:21:12.344698 (+ 1844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:12.344724 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:12.345268 (+ 544us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:12.345740 (+ 472us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:12.346371 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:12.347813 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:12.349693 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:12.350518 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:12.350678 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:12.352032 (+ 1354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:12.352040 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:12.352055 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:12.352667 (+ 612us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:12.352777 (+ 110us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:12.352800 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:12.352892 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:12.353171 (+ 279us) server_negotiation.cc:299] Negotiation successful
0812 00:21:12.353621 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":821,"thread_start_us":488,"threads_started":1}
I20260812 00:21:12.356094 25145 log.cc:824] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:12.359454 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:21:12.359678 25145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6: No bootstrap required, opened a new log
I20260812 00:21:12.367833 25145 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a76a486c1664f7a88d5aed4c1bcd0d6" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44899 } }
I20260812 00:21:12.368283 25145 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:12.368415 25145 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a76a486c1664f7a88d5aed4c1bcd0d6, State: Initialized, Role: FOLLOWER
I20260812 00:21:12.369095 25145 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a76a486c1664f7a88d5aed4c1bcd0d6" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44899 } }
I20260812 00:21:12.369354 25145 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:21:12.369516 25145 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:21:12.369777 25145 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:12.372478 25145 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a76a486c1664f7a88d5aed4c1bcd0d6" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44899 } }
I20260812 00:21:12.373085 25145 leader_election.cc:302] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a76a486c1664f7a88d5aed4c1bcd0d6; no voters:
I20260812 00:21:12.373836 25145 leader_election.cc:288] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:21:12.374015 25151 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:12.374918 25151 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [term 1 LEADER]: Becoming Leader. State: Replica: 2a76a486c1664f7a88d5aed4c1bcd0d6, State: Running, Role: LEADER
I20260812 00:21:12.375553 25151 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a76a486c1664f7a88d5aed4c1bcd0d6" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44899 } }
I20260812 00:21:12.376374 25145 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:21:12.379143 25153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a76a486c1664f7a88d5aed4c1bcd0d6. Latest consensus state: current_term: 1 leader_uuid: "2a76a486c1664f7a88d5aed4c1bcd0d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a76a486c1664f7a88d5aed4c1bcd0d6" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44899 } } }
I20260812 00:21:12.379240 25152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a76a486c1664f7a88d5aed4c1bcd0d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a76a486c1664f7a88d5aed4c1bcd0d6" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44899 } } }
I20260812 00:21:12.379684 25153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:12.379704 25152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:12.380760 25160 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:21:12.387944 25160 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:21:12.397711 25160 catalog_manager.cc:1347] Generated new cluster ID: ec8a92eeaa014ff3a558650a01d8eab7
I20260812 00:21:12.397850 25160 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:21:12.415732 25160 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:21:12.417840 25160 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:21:12.431056 25160 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a76a486c1664f7a88d5aed4c1bcd0d6: Generated new TSK 0
I20260812 00:21:12.432245 25160 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 00:21:12.473223 25177 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 00:21:12.473381 25177 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 00:21:12.474637 25148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:12.454177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34924 (local address 127.18.163.254:44899)
0812 00:21:12.454376 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:12.454384 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:12.454984 (+ 600us) server_negotiation.cc:407] Connection header received
0812 00:21:12.455242 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:12.455247 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:12.455334 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:12.455471 (+ 137us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:21:12.456068 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:12.456807 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:12.458903 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:12.459377 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:12.459479 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:12.460067 (+ 588us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:21:12.474004 (+ 13937us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39305/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 00:21:12.474379 (+ 375us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34924: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39305/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":52}
W20260812 00:21:12.474819 25148 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34924: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39305/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260812 00:21:12.475107 25176 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:12.454125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44899 (local address 127.0.0.1:34924)
0812 00:21:12.454858 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:12.454880 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:12.455047 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:12.455520 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:12.455525 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:12.455539 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:21:12.455872 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:12.455885 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:12.456955 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:12.456961 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:12.458749 (+ 1788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:12.458765 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:12.459557 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:12.459563 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:12.459771 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:12.459821 (+ 50us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:21:12.474308 (+ 14487us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39305/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 00:21:12.474659 (+ 351us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.163.254:44899: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39305/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":365,"threads_started":1}
I20260812 00:21:12.476544 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 25072
I20260812 00:21:12.477943 25140 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:12.578485 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 25072
2026-08-12T00:21:12Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (828 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 00:21:12.644130 19087 mini_oidc.cc:152] Starting JWKS server
I20260812 00:21:12.646240 19087 webserver.cc:460] Webserver started at https://127.0.0.1:32813/ using document root <none> and password file <none>
I20260812 00:21:12.646513 19087 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 00:21:12.647207 19087 webserver.cc:460] Webserver started at http://127.0.0.1:40313/ using document root <none> and password file <none>
2026-08-12T00:21:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:21:12Z Disabled control of system clock
I20260812 00:21:12.689455 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:46675
--webserver_interface=127.18.163.254
--webserver_port=0
--builtin_ntp_servers=127.18.163.212:38919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:46675
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32813/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 00:21:13.045837 25187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:13.046221 25187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:13.046377 25187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:13.054118 25187 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:21:13.054278 25187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:13.054363 25187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:13.054477 25187 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:21:13.054581 25187 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:21:13.054698 25187 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:21:13.054780 25187 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:32813/jwks.json
I20260812 00:21:13.064694 25187 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:38919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:46675
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:46675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32813/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:13.066233 25187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:13.068253 25187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:13.083843 25193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:13.083925 25192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:13.083801 25195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:13.084553 25187 server_base.cc:1034] running on GCE node
I20260812 00:21:13.085532 25187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:13.087209 25187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:13.088434 25187 hybrid_clock.cc:648] HybridClock initialized: now 1786494073088391 us; error 38 us; skew 500 ppm
I20260812 00:21:13.088845 25187 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:21:13.091434 25187 webserver.cc:460] Webserver started at http://127.18.163.254:41559/ using document root <none> and password file <none>
I20260812 00:21:13.092258 25187 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:13.092393 25187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:13.092763 25187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:13.096035 25187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "9c141fe6a5a240d7817daad2a0bc4c7d"
format_stamp: "Formatted at 2026-08-12 00:21:13 on dist-test-slave-njxd"
server_key: "5904f2c04f6d64798ece274ce64417b4"
server_key_iv: "25e39404d851e1248880c94a766c9258"
server_key_version: "encryptionkey@0"
I20260812 00:21:13.097229 25187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "9c141fe6a5a240d7817daad2a0bc4c7d"
format_stamp: "Formatted at 2026-08-12 00:21:13 on dist-test-slave-njxd"
server_key: "5904f2c04f6d64798ece274ce64417b4"
server_key_iv: "25e39404d851e1248880c94a766c9258"
server_key_version: "encryptionkey@0"
I20260812 00:21:13.103338 25187 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260812 00:21:13.107412 25201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:13.108898 25187 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:21:13.109118 25187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "9c141fe6a5a240d7817daad2a0bc4c7d"
format_stamp: "Formatted at 2026-08-12 00:21:13 on dist-test-slave-njxd"
server_key: "5904f2c04f6d64798ece274ce64417b4"
server_key_iv: "25e39404d851e1248880c94a766c9258"
server_key_version: "encryptionkey@0"
I20260812 00:21:13.109364 25187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:13.140005 25187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:13.141011 25187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:13.141367 25187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:13.161744 25187 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:46675
I20260812 00:21:13.161765 25259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:46675 every 8 connection(s)
I20260812 00:21:13.163311 25187 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:21:13.167469 25260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:13.167613 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 25187
I20260812 00:21:13.167892 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:21:13.168584 19087 external_mini_cluster.cc:1428] Setting key 732ed8ea65474e53a4e40d66cc6e3d9e
I20260812 00:21:13.182840 25260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d: Bootstrap starting.
I20260812 00:21:13.184769 25263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:13.170703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54236 (local address 127.18.163.254:46675)
0812 00:21:13.171991 (+ 1288us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:13.172003 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:13.172061 (+ 58us) server_negotiation.cc:407] Connection header received
0812 00:21:13.174222 (+ 2161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:13.174253 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:13.174860 (+ 607us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:13.175267 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:13.175969 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:13.177274 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:13.179367 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:13.180219 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:13.180501 (+ 282us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:13.182176 (+ 1675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:13.182185 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:13.182201 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:13.182809 (+ 608us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:13.182906 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:13.182934 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:13.183084 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:13.183345 (+ 261us) server_negotiation.cc:299] Negotiation successful
0812 00:21:13.183712 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":786,"thread_start_us":541,"threads_started":1}
I20260812 00:21:13.186653 25260 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:13.187928 25260 log.cc:824] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:13.189280 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:21:13.191344 25260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d: No bootstrap required, opened a new log
I20260812 00:21:13.199854 25260 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c141fe6a5a240d7817daad2a0bc4c7d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46675 } }
I20260812 00:21:13.200315 25260 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:13.200443 25260 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c141fe6a5a240d7817daad2a0bc4c7d, State: Initialized, Role: FOLLOWER
I20260812 00:21:13.201179 25260 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c141fe6a5a240d7817daad2a0bc4c7d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46675 } }
I20260812 00:21:13.201478 25260 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:21:13.201705 25260 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:21:13.201936 25260 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:13.204356 25260 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c141fe6a5a240d7817daad2a0bc4c7d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46675 } }
I20260812 00:21:13.204913 25260 leader_election.cc:302] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c141fe6a5a240d7817daad2a0bc4c7d; no voters:
I20260812 00:21:13.205545 25260 leader_election.cc:288] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:21:13.205804 25265 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:13.206574 25265 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [term 1 LEADER]: Becoming Leader. State: Replica: 9c141fe6a5a240d7817daad2a0bc4c7d, State: Running, Role: LEADER
I20260812 00:21:13.207237 25265 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c141fe6a5a240d7817daad2a0bc4c7d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46675 } }
I20260812 00:21:13.208158 25260 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:21:13.210836 25268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c141fe6a5a240d7817daad2a0bc4c7d. Latest consensus state: current_term: 1 leader_uuid: "9c141fe6a5a240d7817daad2a0bc4c7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c141fe6a5a240d7817daad2a0bc4c7d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46675 } } }
I20260812 00:21:13.211400 25268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:13.212000 25266 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c141fe6a5a240d7817daad2a0bc4c7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c141fe6a5a240d7817daad2a0bc4c7d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46675 } } }
I20260812 00:21:13.212416 25266 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:13.214973 25275 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:21:13.221015 25275 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:21:13.230845 25275 catalog_manager.cc:1347] Generated new cluster ID: 52b5707071f64624b5730f3ef6831780
I20260812 00:21:13.230993 25275 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:21:13.243127 25275 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:21:13.245064 25275 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:21:13.259507 25275 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c141fe6a5a240d7817daad2a0bc4c7d: Generated new TSK 0
I20260812 00:21:13.260757 25275 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:21:13.289775 25263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:13.280450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54248 (local address 127.18.163.254:46675)
0812 00:21:13.280687 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:13.280694 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:13.281179 (+ 485us) server_negotiation.cc:407] Connection header received
0812 00:21:13.281410 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:13.281418 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:13.281525 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:13.281749 (+ 224us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:21:13.282248 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:13.283450 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:13.284945 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:13.285731 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:13.285876 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:13.286426 (+ 550us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:21:13.289010 (+ 2584us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32813/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 00:21:13.289398 (+ 388us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54248: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32813/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":76}
W20260812 00:21:13.289921 25263 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54248: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32813/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 00:21:13.291702 25294 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:13.280299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46675 (local address 127.0.0.1:54248)
0812 00:21:13.281052 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:13.281069 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:13.281212 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:13.281775 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:13.281778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:13.281789 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:21:13.282089 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:13.282097 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:13.283624 (+ 1527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:13.283628 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:13.284765 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:13.284778 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:13.285941 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:13.285946 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:13.286085 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:13.286124 (+ 39us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:21:13.289280 (+ 3156us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32813/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 00:21:13.291219 (+ 1939us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.163.254:46675: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32813/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":605,"mutex_wait_us":1570,"thread_start_us":435,"threads_started":1}
I20260812 00:21:13.292968 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 25187
I20260812 00:21:13.294505 25254 generic_service.cc:196] Checking for leaks (request via RPC)
E20260812 00:21:13.305522 25295 webserver.cc:533] Webserver: sslize failed:
E20260812 00:21:13.305737 25295 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 00:21:13.392776 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 25187
2026-08-12T00:21:13Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (811 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T00:21:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:21:13Z Disabled control of system clock
I20260812 00:21:13.498216 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:35385
--webserver_interface=127.18.163.254
--webserver_port=0
--builtin_ntp_servers=127.18.163.212:40655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:35385
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/testchainca.cert with env {}
W20260812 00:21:13.867762 25303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:13.868094 25303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:13.868281 25303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:13.876579 25303 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:21:13.876710 25303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:13.876755 25303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:13.876837 25303 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:21:13.876933 25303 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:21:13.877046 25303 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:21:13.877122 25303 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 00:21:13.888000 25303 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:40655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:35385
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:35385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:13.889515 25303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:13.891067 25303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:13.904408 25308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:13.904434 25311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:13.904346 25309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:13.905644 25303 server_base.cc:1034] running on GCE node
I20260812 00:21:13.906587 25303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:13.908268 25303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:13.909543 25303 hybrid_clock.cc:648] HybridClock initialized: now 1786494073909474 us; error 71 us; skew 500 ppm
I20260812 00:21:13.910009 25303 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:21:13.916859 25303 webserver.cc:460] Webserver started at http://127.18.163.254:44995/ using document root <none> and password file <none>
I20260812 00:21:13.917819 25303 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:13.917956 25303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:13.918320 25303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:13.921569 25303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "fb7b319f2ca64a33a1c1d4b3c9cab8db"
format_stamp: "Formatted at 2026-08-12 00:21:13 on dist-test-slave-njxd"
server_key: "b64d9605f94841d7304b2b81fb15b2e5"
server_key_iv: "21cd82f5cb649c1ca108cb8881428f0e"
server_key_version: "encryptionkey@0"
I20260812 00:21:13.922626 25303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "fb7b319f2ca64a33a1c1d4b3c9cab8db"
format_stamp: "Formatted at 2026-08-12 00:21:13 on dist-test-slave-njxd"
server_key: "b64d9605f94841d7304b2b81fb15b2e5"
server_key_iv: "21cd82f5cb649c1ca108cb8881428f0e"
server_key_version: "encryptionkey@0"
I20260812 00:21:13.928663 25303 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.002s
I20260812 00:21:13.932719 25318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:13.934458 25303 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:21:13.934717 25303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "fb7b319f2ca64a33a1c1d4b3c9cab8db"
format_stamp: "Formatted at 2026-08-12 00:21:13 on dist-test-slave-njxd"
server_key: "b64d9605f94841d7304b2b81fb15b2e5"
server_key_iv: "21cd82f5cb649c1ca108cb8881428f0e"
server_key_version: "encryptionkey@0"
I20260812 00:21:13.934973 25303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:13.987778 25303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:13.988813 25303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:13.989166 25303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:14.010048 25303 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:35385
I20260812 00:21:14.010072 25377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:35385 every 8 connection(s)
I20260812 00:21:14.011622 25303 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:21:14.015970 25378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:14.019749 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 25303
I20260812 00:21:14.019994 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:21:14.020715 19087 external_mini_cluster.cc:1428] Setting key 9c67bc2fd3626bfd1a6101abd13f98cf
I20260812 00:21:14.031361 25378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db: Bootstrap starting.
I20260812 00:21:14.035895 25378 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:14.037417 25378 log.cc:824] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:14.037945 25382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:14.023137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35722 (local address 127.18.163.254:35385)
0812 00:21:14.024352 (+ 1215us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:14.024371 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:14.024431 (+ 60us) server_negotiation.cc:407] Connection header received
0812 00:21:14.026376 (+ 1945us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:14.026416 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:14.027174 (+ 758us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:14.027714 (+ 540us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:14.028358 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:14.030425 (+ 2067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:14.031867 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:14.032964 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:14.033201 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:14.034514 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:14.034526 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:14.034572 (+ 46us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:21:14.035392 (+ 820us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:14.035528 (+ 136us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:21:14.035571 (+ 43us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:14.035706 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:14.035947 (+ 241us) server_negotiation.cc:299] Negotiation successful
0812 00:21:14.036413 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":375,"threads_started":1}
I20260812 00:21:14.041131 25378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db: No bootstrap required, opened a new log
I20260812 00:21:14.042644 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:21:14.050083 25378 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7b319f2ca64a33a1c1d4b3c9cab8db" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35385 } }
I20260812 00:21:14.050542 25378 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:14.050678 25378 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7b319f2ca64a33a1c1d4b3c9cab8db, State: Initialized, Role: FOLLOWER
I20260812 00:21:14.051364 25378 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7b319f2ca64a33a1c1d4b3c9cab8db" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35385 } }
I20260812 00:21:14.051617 25378 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:21:14.051785 25378 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:21:14.051978 25378 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:14.054768 25378 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7b319f2ca64a33a1c1d4b3c9cab8db" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35385 } }
I20260812 00:21:14.055398 25378 leader_election.cc:302] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb7b319f2ca64a33a1c1d4b3c9cab8db; no voters:
I20260812 00:21:14.056087 25378 leader_election.cc:288] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:21:14.056264 25384 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:14.057112 25384 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [term 1 LEADER]: Becoming Leader. State: Replica: fb7b319f2ca64a33a1c1d4b3c9cab8db, State: Running, Role: LEADER
I20260812 00:21:14.057834 25384 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7b319f2ca64a33a1c1d4b3c9cab8db" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35385 } }
I20260812 00:21:14.058851 25378 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:21:14.063014 25386 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb7b319f2ca64a33a1c1d4b3c9cab8db. Latest consensus state: current_term: 1 leader_uuid: "fb7b319f2ca64a33a1c1d4b3c9cab8db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7b319f2ca64a33a1c1d4b3c9cab8db" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35385 } } }
I20260812 00:21:14.063102 25385 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb7b319f2ca64a33a1c1d4b3c9cab8db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7b319f2ca64a33a1c1d4b3c9cab8db" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35385 } } }
I20260812 00:21:14.063472 25386 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:14.063522 25385 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:14.067101 25390 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:21:14.073122 25390 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:21:14.083125 25390 catalog_manager.cc:1347] Generated new cluster ID: ad5509de566a40268cfa58c5b6d4f32f
I20260812 00:21:14.083274 25390 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:21:14.098371 25390 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:21:14.100112 25390 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:21:14.110730 25390 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb7b319f2ca64a33a1c1d4b3c9cab8db: Generated new TSK 0
I20260812 00:21:14.111937 25390 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:21:14.594646 25382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:14.136150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35728 (local address 127.18.163.254:35385)
0812 00:21:14.136410 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:14.136416 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:14.136827 (+ 411us) server_negotiation.cc:407] Connection header received
0812 00:21:14.137079 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:14.137083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:14.137161 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:14.137316 (+ 155us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:21:14.137954 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:14.138764 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:14.141015 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:14.141498 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:14.141672 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:14.142249 (+ 577us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:21:14.593737 (+451488us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 00:21:14.594294 (+ 557us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35728: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":111}
W20260812 00:21:14.594789 25382 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35728: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 00:21:14.595082 25408 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:14.135950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35385 (local address 127.0.0.1:35728)
0812 00:21:14.136692 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:14.136714 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:14.136885 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:14.137372 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:14.137379 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:14.137394 (+ 15us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:21:14.137786 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:14.137801 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:14.138917 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:14.138923 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:14.140831 (+ 1908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:14.140850 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:14.141726 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:14.141733 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:14.141924 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:14.141979 (+ 55us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:21:14.594228 (+452249us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 00:21:14.594658 (+ 430us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.163.254:35385: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":362,"threads_started":1}
I20260812 00:21:14.596907 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 25303
I20260812 00:21:14.598253 25373 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:14.706072 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 25303
2026-08-12T00:21:14Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1295 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (463 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (450 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:21:15 dist-test-slave-njxd krb5kdc[25425](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:21:15 dist-test-slave-njxd krb5kdc[25425](info): set up 2 sockets
Aug 12 00:21:15 dist-test-slave-njxd krb5kdc[25425](info): commencing operation
krb5kdc: starting...
W20260812 00:21:16.821849 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.155s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:21:16 dist-test-slave-njxd krb5kdc[25425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:21:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:21:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:21:17.110069 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44513
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:44513
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:17.469848 25439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:17.470197 25439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:17.470373 25439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:17.478045 25439 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:21:17.478166 25439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:17.478250 25439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:17.478353 25439 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:21:17.478434 25439 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:21:17.488765 25439 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:44513
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:17.490290 25439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:17.491690 25439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:17.504333 25445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:17.504230 25448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:17.504904 25446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:17.505704 25439 server_base.cc:1034] running on GCE node
I20260812 00:21:17.506626 25439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:17.508118 25439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:17.509364 25439 hybrid_clock.cc:648] HybridClock initialized: now 1786494077509313 us; error 40 us; skew 500 ppm
I20260812 00:21:17.509793 25439 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:17 dist-test-slave-njxd krb5kdc[25425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494077, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:17.512936 25439 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:21:17.514554 25439 webserver.cc:460] Webserver started at http://127.18.163.254:34009/ using document root <none> and password file <none>
I20260812 00:21:17.515321 25439 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:17.515475 25439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:17.515818 25439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:17.519587 25439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "f5695ef9f3064a5d8e00c7f58b05522f"
format_stamp: "Formatted at 2026-08-12 00:21:17 on dist-test-slave-njxd"
server_key: "c87e62a309170882eab0d172b40ed544"
server_key_iv: "d2ba118aeb828a1ab88bcb1bb487b710"
server_key_version: "encryptionkey@0"
I20260812 00:21:17.520454 25439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "f5695ef9f3064a5d8e00c7f58b05522f"
format_stamp: "Formatted at 2026-08-12 00:21:17 on dist-test-slave-njxd"
server_key: "c87e62a309170882eab0d172b40ed544"
server_key_iv: "d2ba118aeb828a1ab88bcb1bb487b710"
server_key_version: "encryptionkey@0"
I20260812 00:21:17.526171 25439 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 00:21:17.529979 25456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:17.531337 25439 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:21:17.531533 25439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "f5695ef9f3064a5d8e00c7f58b05522f"
format_stamp: "Formatted at 2026-08-12 00:21:17 on dist-test-slave-njxd"
server_key: "c87e62a309170882eab0d172b40ed544"
server_key_iv: "d2ba118aeb828a1ab88bcb1bb487b710"
server_key_version: "encryptionkey@0"
I20260812 00:21:17.531747 25439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:17.564930 25439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:17.570255 25439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:17.570607 25439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:17.591004 25439 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:44513
I20260812 00:21:17.591038 25511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:44513 every 8 connection(s)
I20260812 00:21:17.592571 25439 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:21:17.596642 25513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:17.600638 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 25439
I20260812 00:21:17.600878 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:21:17.601522 19087 external_mini_cluster.cc:1428] Setting key e2544889233d22a8c09afb589e24ff6e
I20260812 00:21:17.611265 25513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f: Bootstrap starting.
I20260812 00:21:17.615756 25513 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:17.617291 25513 log.cc:824] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f: Log is configured to *not* fsync() on all Append() calls
Aug 12 00:21:17 dist-test-slave-njxd krb5kdc[25425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:21:17.621031 25513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f: No bootstrap required, opened a new log
I20260812 00:21:17.628291 25516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:17.603689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41838 (local address 127.18.163.254:44513)
0812 00:21:17.604525 (+ 836us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:17.604537 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:17.604579 (+ 42us) server_negotiation.cc:407] Connection header received
0812 00:21:17.606783 (+ 2204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:17.606814 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:17.607421 (+ 607us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:17.607955 (+ 534us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:17.610031 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:17.611378 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:17.613292 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:17.614284 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:17.614434 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:17.619985 (+ 5551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:17.619993 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:17.620010 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:17.620054 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:17.623415 (+ 3361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:17.624418 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:17.624425 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:17.624435 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:17.624625 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:17.625120 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:17.625123 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:17.625125 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:17.625809 (+ 684us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:17.626061 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:17.626619 (+ 558us) server_negotiation.cc:299] Negotiation successful
0812 00:21:17.627086 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":395,"threads_started":1}
I20260812 00:21:17.630915 25513 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5695ef9f3064a5d8e00c7f58b05522f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44513 } }
I20260812 00:21:17.631424 25513 raft_consensus.cc:374] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:17.631534 25513 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5695ef9f3064a5d8e00c7f58b05522f, State: Initialized, Role: FOLLOWER
I20260812 00:21:17.632156 25513 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5695ef9f3064a5d8e00c7f58b05522f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44513 } }
I20260812 00:21:17.632426 25513 raft_consensus.cc:388] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:21:17.632577 25513 raft_consensus.cc:482] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:21:17.632763 25513 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:17.635473 25513 raft_consensus.cc:504] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5695ef9f3064a5d8e00c7f58b05522f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44513 } }
I20260812 00:21:17.636091 25513 leader_election.cc:302] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5695ef9f3064a5d8e00c7f58b05522f; no voters:
I20260812 00:21:17.636785 25513 leader_election.cc:288] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:21:17.636916 25518 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:17.637737 25518 raft_consensus.cc:686] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [term 1 LEADER]: Becoming Leader. State: Replica: f5695ef9f3064a5d8e00c7f58b05522f, State: Running, Role: LEADER
I20260812 00:21:17.638334 25518 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5695ef9f3064a5d8e00c7f58b05522f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44513 } }
I20260812 00:21:17.639217 25513 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:21:17.641541 25520 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5695ef9f3064a5d8e00c7f58b05522f. Latest consensus state: current_term: 1 leader_uuid: "f5695ef9f3064a5d8e00c7f58b05522f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5695ef9f3064a5d8e00c7f58b05522f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44513 } } }
I20260812 00:21:17.641763 25519 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5695ef9f3064a5d8e00c7f58b05522f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5695ef9f3064a5d8e00c7f58b05522f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44513 } } }
I20260812 00:21:17.642076 25519 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:17.642077 25520 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:17.643006 25528 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:21:17.648864 25528 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:21:17.666129 25528 catalog_manager.cc:1347] Generated new cluster ID: 0fe098d9bfbe4ae0b334185f97a0fab5
I20260812 00:21:17.666286 25528 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:21:17.677109 25528 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:21:17.679111 25528 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:21:17.687755 25528 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f5695ef9f3064a5d8e00c7f58b05522f: Generated new TSK 0
I20260812 00:21:17.688984 25528 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:21:17.756913 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44513
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:18.125411 25542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:18.125797 25542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:18.125906 25542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:18.133704 25542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:18.133829 25542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:18.133949 25542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:21:18.144619 25542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44513
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:18.146160 25542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:18.147490 25542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:18.162747 25552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:18.162853 25549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:18.162775 25548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:18.167389 25542 server_base.cc:1034] running on GCE node
I20260812 00:21:18.168185 25542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:18.169662 25542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:18.170949 25542 hybrid_clock.cc:648] HybridClock initialized: now 1786494078170839 us; error 117 us; skew 500 ppm
I20260812 00:21:18.171314 25542 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:18 dist-test-slave-njxd krb5kdc[25425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494078, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:18.174954 25542 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:21:18.176755 25542 webserver.cc:460] Webserver started at http://127.18.163.193:36945/ using document root <none> and password file <none>
I20260812 00:21:18.177565 25542 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:18.177781 25542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:18.178150 25542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:18.181356 25542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "72dc0d50aae6425c978d7be618c882ab"
format_stamp: "Formatted at 2026-08-12 00:21:18 on dist-test-slave-njxd"
server_key: "7259bc6f281a157b47d5d1dffaf68402"
server_key_iv: "fc2e22f114404d8c0ab815065dd59a24"
server_key_version: "encryptionkey@0"
I20260812 00:21:18.182310 25542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "72dc0d50aae6425c978d7be618c882ab"
format_stamp: "Formatted at 2026-08-12 00:21:18 on dist-test-slave-njxd"
server_key: "7259bc6f281a157b47d5d1dffaf68402"
server_key_iv: "fc2e22f114404d8c0ab815065dd59a24"
server_key_version: "encryptionkey@0"
I20260812 00:21:18.188359 25542 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:21:18.192205 25561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:18.193744 25542 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 00:21:18.193938 25542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "72dc0d50aae6425c978d7be618c882ab"
format_stamp: "Formatted at 2026-08-12 00:21:18 on dist-test-slave-njxd"
server_key: "7259bc6f281a157b47d5d1dffaf68402"
server_key_iv: "fc2e22f114404d8c0ab815065dd59a24"
server_key_version: "encryptionkey@0"
I20260812 00:21:18.194181 25542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:18.212373 25542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:18.217206 25542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:18.217527 25542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:18.218647 25542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:18.220120 25542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:18.220239 25542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:18.220405 25542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:18.220481 25542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:18.256171 25542 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:37733
I20260812 00:21:18.256210 25691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:37733 every 8 connection(s)
I20260812 00:21:18.257561 25542 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:21:18.267639 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 25542
I20260812 00:21:18.267891 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:21:18.268543 19087 external_mini_cluster.cc:1428] Setting key 5873964502303f516dfffbf5d0dcae28
Aug 12 00:21:18 dist-test-slave-njxd krb5kdc[25425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494078, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:21:18.280611 25694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:18.260447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:59033 (local address 127.18.163.254:44513)
0812 00:21:18.260957 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:18.260962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:18.261933 (+ 971us) server_negotiation.cc:407] Connection header received
0812 00:21:18.263906 (+ 1973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:18.263912 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:18.264013 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:18.264140 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:18.265853 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:18.266607 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:18.268397 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:18.268881 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:18.269027 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:18.273120 (+ 4093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:18.273130 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:18.273138 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:18.273189 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:18.276955 (+ 3766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:18.277880 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:18.277888 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:18.277894 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:18.278055 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:18.278497 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:18.278504 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:18.278509 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:18.278925 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:18.279093 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:18.279842 (+ 749us) server_negotiation.cc:299] Negotiation successful
0812 00:21:18.280115 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":295,"threads_started":1}
I20260812 00:21:18.281342 25695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:18.260951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44513 (local address 127.18.163.193:59033)
0812 00:21:18.261764 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:18.261806 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:18.263588 (+ 1782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:18.264404 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:18.264414 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:18.264987 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:18.265658 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:18.265680 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:18.266798 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:18.266802 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:18.268238 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:18.268251 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:18.269148 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:18.269157 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:18.269489 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:18.270269 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:18.270298 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:18.272837 (+ 2539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:18.277142 (+ 4305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:18.277151 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:18.277166 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:18.277731 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:18.278171 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:18.278175 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:18.278177 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:18.278379 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:18.279054 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:18.279060 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:18.279426 (+ 366us) client_negotiation.cc:769] Sending connection context
0812 00:21:18.279663 (+ 237us) client_negotiation.cc:240] Negotiation successful
0812 00:21:18.280087 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":295,"threads_started":1}
I20260812 00:21:18.283109 25692 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44513
I20260812 00:21:18.283516 25692 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:18.284325 25692 heartbeater.cc:511] Master 127.18.163.254:44513 requested a full tablet report, sending...
I20260812 00:21:18.286623 25477 ts_manager.cc:194] Registered new tserver with Master: 72dc0d50aae6425c978d7be618c882ab (127.18.163.193:37733)
I20260812 00:21:18.288161 25477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:59033
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:21:18.332631 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44513
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:18.698387 25698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:18.698745 25698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:18.698945 25698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:18.706399 25698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:18.706521 25698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:18.706635 25698 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:21:18.716848 25698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44513
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:18.718264 25698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:18.719615 25698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:18.733732 25705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:18.733804 25703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:18.733842 25708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:18.734640 25698 server_base.cc:1034] running on GCE node
I20260812 00:21:18.735477 25698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:18.736574 25698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:18.737821 25698 hybrid_clock.cc:648] HybridClock initialized: now 1786494078737761 us; error 55 us; skew 500 ppm
I20260812 00:21:18.738168 25698 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:18 dist-test-slave-njxd krb5kdc[25425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494078, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:18.741781 25698 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:21:18.743383 25698 webserver.cc:460] Webserver started at http://127.18.163.194:38871/ using document root <none> and password file <none>
I20260812 00:21:18.744158 25698 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:18.744323 25698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:18.744661 25698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:18.747929 25698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "300e0491ca6648b38bbbbd276876fff3"
format_stamp: "Formatted at 2026-08-12 00:21:18 on dist-test-slave-njxd"
server_key: "8fde084cfea8e0207874fa608ae66c4d"
server_key_iv: "fe5b0047bff8754d58dee86327c748dc"
server_key_version: "encryptionkey@0"
I20260812 00:21:18.748818 25698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "300e0491ca6648b38bbbbd276876fff3"
format_stamp: "Formatted at 2026-08-12 00:21:18 on dist-test-slave-njxd"
server_key: "8fde084cfea8e0207874fa608ae66c4d"
server_key_iv: "fe5b0047bff8754d58dee86327c748dc"
server_key_version: "encryptionkey@0"
I20260812 00:21:18.754768 25698 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 00:21:18.759071 25715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:18.760582 25698 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260812 00:21:18.760800 25698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "300e0491ca6648b38bbbbd276876fff3"
format_stamp: "Formatted at 2026-08-12 00:21:18 on dist-test-slave-njxd"
server_key: "8fde084cfea8e0207874fa608ae66c4d"
server_key_iv: "fe5b0047bff8754d58dee86327c748dc"
server_key_version: "encryptionkey@0"
I20260812 00:21:18.761039 25698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:18.786118 25698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:18.790537 25698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:18.790879 25698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:18.792014 25698 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:18.793498 25698 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:18.793638 25698 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:18.793802 25698 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:18.793879 25698 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:18.830314 25698 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:45009
I20260812 00:21:18.830372 25841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:45009 every 8 connection(s)
I20260812 00:21:18.831703 25698 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:21:18.833052 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 25698
I20260812 00:21:18.833287 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:21:18.833865 19087 external_mini_cluster.cc:1428] Setting key a5f42266d482ca0a525ed04aa0cc4667
Aug 12 00:21:18 dist-test-slave-njxd krb5kdc[25425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494078, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:21:18.855078 25845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:18.834766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:37339 (local address 127.18.163.254:44513)
0812 00:21:18.835280 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:18.835287 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:18.836494 (+ 1207us) server_negotiation.cc:407] Connection header received
0812 00:21:18.838567 (+ 2073us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:18.838576 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:18.838682 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:18.838830 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:18.840605 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:18.841878 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:18.843589 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:18.844045 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:18.844207 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:18.848323 (+ 4116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:18.848332 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:18.848338 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:18.848396 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:18.851192 (+ 2796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:18.852350 (+ 1158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:18.852354 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:18.852356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:18.852500 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:18.853023 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:18.853026 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:18.853028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:18.853322 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:18.853440 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:18.854593 (+ 1153us) server_negotiation.cc:299] Negotiation successful
0812 00:21:18.854794 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":263,"threads_started":1}
I20260812 00:21:18.856921 25846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:18.835360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44513 (local address 127.18.163.194:37339)
0812 00:21:18.836273 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:18.836351 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:18.838249 (+ 1898us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:18.839053 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:18.839063 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:18.839698 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:18.840403 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:18.840424 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:18.842058 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:18.842062 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:18.843391 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:18.843405 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:18.844338 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:18.844346 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:18.844603 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:18.845398 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:18.845424 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:18.847966 (+ 2542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:18.851376 (+ 3410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:18.851389 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:18.851411 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:18.852215 (+ 804us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:18.852618 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:18.852625 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:18.852631 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:18.852910 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:18.853467 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:18.853479 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:18.854084 (+ 605us) client_negotiation.cc:769] Sending connection context
0812 00:21:18.854486 (+ 402us) client_negotiation.cc:240] Negotiation successful
0812 00:21:18.855160 (+ 674us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":402,"threads_started":1}
I20260812 00:21:18.858734 25842 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44513
I20260812 00:21:18.859133 25842 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:18.859957 25842 heartbeater.cc:511] Master 127.18.163.254:44513 requested a full tablet report, sending...
I20260812 00:21:18.861881 25477 ts_manager.cc:194] Registered new tserver with Master: 300e0491ca6648b38bbbbd276876fff3 (127.18.163.194:45009)
I20260812 00:21:18.863313 25477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:37339
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
I20260812 00:21:18.901427 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44513
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:19.269467 25849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:19.269857 25849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:19.270051 25849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:19.277693 25849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:19.277841 25849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:19.278033 25849 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:21:19.289211 25849 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44513
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:19.291052 25849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:19.291460 25692 heartbeater.cc:503] Master 127.18.163.254:44513 was elected leader, sending a full tablet report...
I20260812 00:21:19.292842 25849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:19.310628 25855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:19.310665 25856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:19.310617 25858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:19.312602 25849 server_base.cc:1034] running on GCE node
I20260812 00:21:19.313524 25849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:19.314992 25849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:19.316291 25849 hybrid_clock.cc:648] HybridClock initialized: now 1786494079316161 us; error 115 us; skew 500 ppm
I20260812 00:21:19.316761 25849 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:19 dist-test-slave-njxd krb5kdc[25425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494079, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:19.321851 25849 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:21:19.323994 25849 webserver.cc:460] Webserver started at http://127.18.163.195:35765/ using document root <none> and password file <none>
I20260812 00:21:19.325160 25849 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:19.325337 25849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:19.325817 25849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:19.329474 25849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "a495f8f02f3f4ee3a8169a3b7b057a06"
format_stamp: "Formatted at 2026-08-12 00:21:19 on dist-test-slave-njxd"
server_key: "7c4cf545a07f05a9e87271f70ef4c23d"
server_key_iv: "50cf311cbfabc5622cfd56e297cb7a67"
server_key_version: "encryptionkey@0"
I20260812 00:21:19.330649 25849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "a495f8f02f3f4ee3a8169a3b7b057a06"
format_stamp: "Formatted at 2026-08-12 00:21:19 on dist-test-slave-njxd"
server_key: "7c4cf545a07f05a9e87271f70ef4c23d"
server_key_iv: "50cf311cbfabc5622cfd56e297cb7a67"
server_key_version: "encryptionkey@0"
I20260812 00:21:19.338430 25849 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.005s
I20260812 00:21:19.343174 25865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:19.344940 25849 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 00:21:19.345160 25849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "a495f8f02f3f4ee3a8169a3b7b057a06"
format_stamp: "Formatted at 2026-08-12 00:21:19 on dist-test-slave-njxd"
server_key: "7c4cf545a07f05a9e87271f70ef4c23d"
server_key_iv: "50cf311cbfabc5622cfd56e297cb7a67"
server_key_version: "encryptionkey@0"
I20260812 00:21:19.345417 25849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:19.357647 25849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:19.362946 25849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:19.363234 25849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:19.364240 25849 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:19.365958 25849 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:19.366035 25849 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:19.366138 25849 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:19.366184 25849 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:19.399428 25849 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:39255
I20260812 00:21:19.399471 25993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:39255 every 8 connection(s)
I20260812 00:21:19.400827 25849 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:21:19.401875 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 25849
I20260812 00:21:19.402097 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:21:19.402572 19087 external_mini_cluster.cc:1428] Setting key 5666df6f8a552f83c2585bdd24dee817
Aug 12 00:21:19 dist-test-slave-njxd krb5kdc[25425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494079, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:21:19.422941 25996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:19.403835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:51037 (local address 127.18.163.254:44513)
0812 00:21:19.404372 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:19.404379 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:19.405524 (+ 1145us) server_negotiation.cc:407] Connection header received
0812 00:21:19.407605 (+ 2081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:19.407610 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:19.407714 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:19.407841 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:19.409485 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:19.410380 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:19.412016 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:19.412453 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:19.412595 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:19.416306 (+ 3711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:19.416311 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:19.416314 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:19.416351 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:19.419576 (+ 3225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:19.420372 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:19.420380 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:19.420383 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:19.420515 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:19.420977 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:19.420982 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:19.420986 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:19.421280 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:19.421459 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:19.422299 (+ 840us) server_negotiation.cc:299] Negotiation successful
0812 00:21:19.422540 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":250,"threads_started":1}
I20260812 00:21:19.423954 25997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:19.404523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44513 (local address 127.18.163.195:51037)
0812 00:21:19.405368 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:19.405408 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:19.407311 (+ 1903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:19.408109 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:19.408118 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:19.408689 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:19.409301 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:19.409320 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:19.410563 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:19.410567 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:19.411852 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:19.411871 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:19.412701 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:19.412709 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:19.412960 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:19.413739 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:19.413766 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:19.416064 (+ 2298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:19.419728 (+ 3664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:19.419739 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:19.419757 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:19.420241 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:19.420641 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:19.420647 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:19.420650 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:19.420855 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:19.421434 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:19.421443 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:19.421875 (+ 432us) client_negotiation.cc:769] Sending connection context
0812 00:21:19.422179 (+ 304us) client_negotiation.cc:240] Negotiation successful
0812 00:21:19.422765 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":364,"threads_started":1}
I20260812 00:21:19.425364 25994 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44513
I20260812 00:21:19.425753 25994 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:19.426486 25994 heartbeater.cc:511] Master 127.18.163.254:44513 requested a full tablet report, sending...
I20260812 00:21:19.427994 25477 ts_manager.cc:194] Registered new tserver with Master: a495f8f02f3f4ee3a8169a3b7b057a06 (127.18.163.195:39255)
I20260812 00:21:19.428864 25477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:51037
I20260812 00:21:19.431588 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/test-admin.keytab.
Aug 12 00:21:19 dist-test-slave-njxd krb5kdc[25425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:19.468202 19087 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 00:21:19.474186 26004 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:19.471174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35654 (local address 127.18.163.193:37733)
0812 00:21:19.471885 (+ 711us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:19.471895 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:19.471933 (+ 38us) server_negotiation.cc:407] Connection header received
0812 00:21:19.472142 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:19.472151 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:19.472391 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:19.472568 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:19.473655 (+ 1087us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35654: BlockingRecv error: recv got EOF from 127.0.0.1:35654 (error 108)
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":308,"threads_started":1}
W20260812 00:21:19.474640 19087 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/krb5cc' of type FILE
Aug 12 00:21:19 dist-test-slave-njxd krb5kdc[25425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:19.476476 19087 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 00:21:19 dist-test-slave-njxd krb5kdc[25425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:19.477991 19087 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 00:21:19 dist-test-slave-njxd krb5kdc[25425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:21:19.494459 26004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:19.479881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35670 (local address 127.18.163.193:37733)
0812 00:21:19.480100 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:19.480107 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:19.480273 (+ 166us) server_negotiation.cc:407] Connection header received
0812 00:21:19.480501 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:19.480505 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:19.480568 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:19.480673 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:19.481722 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:19.482715 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:19.483950 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:19.484547 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:19.484708 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:19.488444 (+ 3736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:19.488458 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:19.488474 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:19.488521 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:19.491391 (+ 2870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:19.492185 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:19.492194 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:19.492196 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:19.492331 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:19.492724 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:19.492730 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:19.492733 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:19.493135 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:19.493465 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:19.493874 (+ 409us) server_negotiation.cc:299] Negotiation successful
0812 00:21:19.494169 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260812 00:21:19.500979 26004 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:19.498879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35678 (local address 127.18.163.193:37733)
0812 00:21:19.499121 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:19.499131 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:19.499425 (+ 294us) server_negotiation.cc:407] Connection header received
0812 00:21:19.499555 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:19.499559 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:19.499653 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:19.499780 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:19.500736 (+ 956us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35678: BlockingRecv error: recv got EOF from 127.0.0.1:35678 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260812 00:21:19.501169 19087 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/krb5cc' of type FILE
Aug 12 00:21:19 dist-test-slave-njxd krb5kdc[25425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:19.502859 19087 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 00:21:19 dist-test-slave-njxd krb5kdc[25425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:19.504321 19087 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 00:21:19 dist-test-slave-njxd krb5kdc[25425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:21:19.519610 26004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:19.505817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35684 (local address 127.18.163.193:37733)
0812 00:21:19.506073 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:19.506078 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:19.506367 (+ 289us) server_negotiation.cc:407] Connection header received
0812 00:21:19.506562 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:19.506567 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:19.506636 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:19.506742 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:19.507749 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:19.508499 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:19.509843 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:19.510317 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:19.510457 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:19.514288 (+ 3831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:19.514293 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:19.514297 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:19.514333 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:19.516826 (+ 2493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:19.517538 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:19.517544 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:19.517548 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:19.517749 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:19.518166 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:19.518171 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:19.518174 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:19.518489 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:19.518771 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:19.519087 (+ 316us) server_negotiation.cc:299] Negotiation successful
0812 00:21:19.519315 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260812 00:21:19.524036 26004 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:19.522346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35696 (local address 127.18.163.193:37733)
0812 00:21:19.522582 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:19.522588 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:19.522784 (+ 196us) server_negotiation.cc:407] Connection header received
0812 00:21:19.522907 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:19.522911 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:19.522984 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:19.523063 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:19.523785 (+ 722us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35696: BlockingRecv error: recv got EOF from 127.0.0.1:35696 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
W20260812 00:21:19.524211 19087 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494024564100-19087-0/krb5kdc/krb5cc' of type FILE
Aug 12 00:21:19 dist-test-slave-njxd krb5kdc[25425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:19.525925 19087 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 00:21:19 dist-test-slave-njxd krb5kdc[25425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:19.527308 19087 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 00:21:19 dist-test-slave-njxd krb5kdc[25425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:21:19.542996 26004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:19.528779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35708 (local address 127.18.163.193:37733)
0812 00:21:19.529017 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:19.529025 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:19.529311 (+ 286us) server_negotiation.cc:407] Connection header received
0812 00:21:19.529520 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:19.529525 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:19.529655 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:19.529766 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:19.530816 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:19.531561 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:19.532847 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:19.533315 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:19.533458 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:19.537707 (+ 4249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:19.537713 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:19.537717 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:19.537758 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:19.540481 (+ 2723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:19.541193 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:19.541197 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:19.541200 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:19.541349 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:19.541720 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:19.541723 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:19.541726 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:19.542018 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:19.542272 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:19.542523 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 00:21:19.542721 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:21:19.544824 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 25542
I20260812 00:21:19.558413 26004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:19.545751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35712 (local address 127.18.163.193:37733)
0812 00:21:19.545971 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:19.545979 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:19.546222 (+ 243us) server_negotiation.cc:407] Connection header received
0812 00:21:19.546442 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:19.546448 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:19.546521 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:19.546626 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:19.547687 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:19.548396 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:19.549801 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:19.550254 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:19.550427 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:19.552689 (+ 2262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:19.552694 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:19.552698 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:19.552735 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:19.555334 (+ 2599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:19.556117 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:19.556123 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:19.556129 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:19.556279 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:19.556698 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:19.556703 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:19.556708 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:19.557010 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:19.557329 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:19.557700 (+ 371us) server_negotiation.cc:299] Negotiation successful
0812 00:21:19.557977 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 00:21:19.559159 25685 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:19.647477 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 25542
I20260812 00:21:19.672642 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 25698
Aug 12 00:21:19 dist-test-slave-njxd krb5kdc[25425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
I20260812 00:21:19.689828 26018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:19.673676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48140 (local address 127.18.163.194:45009)
0812 00:21:19.674253 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:19.674261 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:19.674287 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:21:19.674349 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:19.674356 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:19.674594 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:19.674779 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:19.675892 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:19.676993 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:19.678388 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:19.678987 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:19.679163 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:19.683359 (+ 4196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:19.683375 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:19.683392 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:19.683435 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:19.686486 (+ 3051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:19.687362 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:19.687370 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:19.687372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:19.687516 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:19.687977 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:19.687981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:19.687984 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:19.688371 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:19.688731 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:19.689092 (+ 361us) server_negotiation.cc:299] Negotiation successful
0812 00:21:19.689392 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":297,"threads_started":1}
I20260812 00:21:19.691257 25837 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:19.778684 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 25698
I20260812 00:21:19.801021 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 25849
Aug 12 00:21:19 dist-test-slave-njxd krb5kdc[25425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:21:19.818385 26020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:19.802362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52604 (local address 127.18.163.195:39255)
0812 00:21:19.803066 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:19.803074 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:19.803105 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:21:19.803169 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:19.803175 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:19.803416 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:19.803554 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:19.804681 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:19.805977 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:19.807431 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:19.808039 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:19.808160 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:19.812442 (+ 4282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:19.812458 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:19.812474 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:19.812518 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:19.815615 (+ 3097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:19.816322 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:19.816329 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:19.816332 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:19.816463 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:19.816816 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:19.816819 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:19.816821 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:19.817181 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:19.817437 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:19.817734 (+ 297us) server_negotiation.cc:299] Negotiation successful
0812 00:21:19.818050 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":385,"threads_started":1}
I20260812 00:21:19.819802 25987 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:19.907012 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 25849
I20260812 00:21:19.929998 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 25439
I20260812 00:21:19.931239 25507 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:20.039242 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 25439
2026-08-12T00:21:20Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4421 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:21:20 dist-test-slave-njxd krb5kdc[26025](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:21:20 dist-test-slave-njxd krb5kdc[26025](info): set up 2 sockets
Aug 12 00:21:20 dist-test-slave-njxd krb5kdc[26025](info): commencing operation
krb5kdc: starting...
W20260812 00:21:21.253921 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:21:21 dist-test-slave-njxd krb5kdc[26025](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:21:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:21:21Z Disabled control of system clock
WARNING: no policy specified for oryx/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.254.keytab.
Entry for principal oryx/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.254.keytab.
I20260812 00:21:21.553004 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:35307
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.254.keytab
--principal=oryx/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:35307
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:21.910874 26040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:21.911267 26040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:21.911441 26040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:21.918991 26040 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:21:21.919176 26040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:21.919296 26040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:21.919405 26040 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:21:21.919500 26040 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:21:21.929909 26040 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:35307
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.254.keytab
--principal=oryx/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:35307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:21.931438 26040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:21.932857 26040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:21.945552 26047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:21.945662 26048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:21.945880 26051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:21.946593 26040 server_base.cc:1034] running on GCE node
I20260812 00:21:21.947496 26040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:21.949072 26040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:21.950300 26040 hybrid_clock.cc:648] HybridClock initialized: now 1786494081950229 us; error 58 us; skew 500 ppm
I20260812 00:21:21.950695 26040 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:21 dist-test-slave-njxd krb5kdc[26025](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494081, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:21.954228 26040 init.cc:377] Logged in from keytab as oryx/127.18.163.254@KRBTEST.COM (short username oryx)
I20260812 00:21:21.955856 26040 webserver.cc:460] Webserver started at http://127.18.163.254:36439/ using document root <none> and password file <none>
I20260812 00:21:21.956595 26040 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:21.956713 26040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:21.957010 26040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:21.960297 26040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "16e941ca289a44a9a99608abd9bb8230"
format_stamp: "Formatted at 2026-08-12 00:21:21 on dist-test-slave-njxd"
server_key: "bb6bbae6e4a4c02edf9cdf252416ad63"
server_key_iv: "8691efab96618f7063650f5b1abd5ced"
server_key_version: "encryptionkey@0"
I20260812 00:21:21.961099 26040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "16e941ca289a44a9a99608abd9bb8230"
format_stamp: "Formatted at 2026-08-12 00:21:21 on dist-test-slave-njxd"
server_key: "bb6bbae6e4a4c02edf9cdf252416ad63"
server_key_iv: "8691efab96618f7063650f5b1abd5ced"
server_key_version: "encryptionkey@0"
I20260812 00:21:21.967296 26040 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260812 00:21:21.971617 26058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:21.973212 26040 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:21:21.973424 26040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "16e941ca289a44a9a99608abd9bb8230"
format_stamp: "Formatted at 2026-08-12 00:21:21 on dist-test-slave-njxd"
server_key: "bb6bbae6e4a4c02edf9cdf252416ad63"
server_key_iv: "8691efab96618f7063650f5b1abd5ced"
server_key_version: "encryptionkey@0"
I20260812 00:21:21.973739 26040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:21.991173 26040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:21.996147 26040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:21.996486 26040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:22.016666 26040 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:35307
I20260812 00:21:22.016702 26120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:35307 every 8 connection(s)
I20260812 00:21:22.018291 26040 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:21:22.022339 26121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:22.023346 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 26040
I20260812 00:21:22.023602 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:21:22.024291 19087 external_mini_cluster.cc:1428] Setting key 914190ccce8eea04f5b6f50f0e3c8749
I20260812 00:21:22.037750 26121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230: Bootstrap starting.
Aug 12 00:21:22 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM
I20260812 00:21:22.041225 26121 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:22.042750 26121 log.cc:824] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:22.046612 26121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230: No bootstrap required, opened a new log
I20260812 00:21:22.050522 26125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:22.026658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57368 (local address 127.18.163.254:35307)
0812 00:21:22.027533 (+ 875us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:22.027563 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:22.027622 (+ 59us) server_negotiation.cc:407] Connection header received
0812 00:21:22.029461 (+ 1839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:22.029491 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:22.030088 (+ 597us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:22.030596 (+ 508us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:22.031964 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:22.034097 (+ 2133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:22.035437 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:22.036532 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:22.036751 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:22.041051 (+ 4300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:22.041066 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:22.041093 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:22.041156 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:22.045364 (+ 4208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:22.046231 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:22.046239 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:22.046248 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:22.046472 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:22.046889 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:22.046895 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:22.046898 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:22.047684 (+ 786us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:22.048006 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:22.048355 (+ 349us) server_negotiation.cc:299] Negotiation successful
0812 00:21:22.048898 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":355,"threads_started":1}
I20260812 00:21:22.056437 26121 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } }
I20260812 00:21:22.056885 26121 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:22.056967 26121 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16e941ca289a44a9a99608abd9bb8230, State: Initialized, Role: FOLLOWER
I20260812 00:21:22.057579 26121 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } }
I20260812 00:21:22.057906 26121 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:21:22.058099 26121 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:21:22.058319 26121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:22.060817 26121 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } }
I20260812 00:21:22.061410 26121 leader_election.cc:302] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16e941ca289a44a9a99608abd9bb8230; no voters:
I20260812 00:21:22.062110 26121 leader_election.cc:288] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:21:22.062268 26127 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:22.063853 26127 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [term 1 LEADER]: Becoming Leader. State: Replica: 16e941ca289a44a9a99608abd9bb8230, State: Running, Role: LEADER
I20260812 00:21:22.064442 26127 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } }
I20260812 00:21:22.064602 26121 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:21:22.067899 26130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16e941ca289a44a9a99608abd9bb8230. Latest consensus state: current_term: 1 leader_uuid: "16e941ca289a44a9a99608abd9bb8230" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } }
I20260812 00:21:22.068351 26130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:22.067907 26129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16e941ca289a44a9a99608abd9bb8230" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } }
I20260812 00:21:22.069545 26129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:22.071861 26137 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:21:22.077173 26137 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:21:22.087764 26137 catalog_manager.cc:1347] Generated new cluster ID: 948a8bfb8dc64a31b2e6944f04b6502d
I20260812 00:21:22.087903 26137 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:21:22.099440 26137 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:21:22.100749 26137 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:21:22.107231 26137 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230: Generated new TSK 0
I20260812 00:21:22.108063 26137 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.193.keytab.
Entry for principal oryx/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.193.keytab.
I20260812 00:21:22.190060 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:35307
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.193.keytab
--principal=oryx/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:22.562594 26149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:22.562906 26149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:22.563109 26149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:22.570865 26149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:22.571018 26149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:22.571228 26149 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:21:22.582424 26149 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.193.keytab
--principal=oryx/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:35307
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:22.583846 26149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:22.585317 26149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:22.599635 26155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:22.599678 26156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:22.599591 26158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:22.600828 26149 server_base.cc:1034] running on GCE node
I20260812 00:21:22.601532 26149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:22.602711 26149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:22.603967 26149 hybrid_clock.cc:648] HybridClock initialized: now 1786494082603924 us; error 56 us; skew 500 ppm
I20260812 00:21:22.604321 26149 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:22 dist-test-slave-njxd krb5kdc[26025](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494082, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:22.607828 26149 init.cc:377] Logged in from keytab as oryx/127.18.163.193@KRBTEST.COM (short username oryx)
I20260812 00:21:22.609433 26149 webserver.cc:460] Webserver started at http://127.18.163.193:38847/ using document root <none> and password file <none>
I20260812 00:21:22.610219 26149 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:22.610368 26149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:22.610745 26149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:22.614084 26149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "2032db1dcec4456783180ee086ed6940"
format_stamp: "Formatted at 2026-08-12 00:21:22 on dist-test-slave-njxd"
server_key: "5aeed8a825919957df0dd24b67f89ecd"
server_key_iv: "24a0c7e7a750ba75496f08b903b6d28f"
server_key_version: "encryptionkey@0"
I20260812 00:21:22.614980 26149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "2032db1dcec4456783180ee086ed6940"
format_stamp: "Formatted at 2026-08-12 00:21:22 on dist-test-slave-njxd"
server_key: "5aeed8a825919957df0dd24b67f89ecd"
server_key_iv: "24a0c7e7a750ba75496f08b903b6d28f"
server_key_version: "encryptionkey@0"
I20260812 00:21:22.620718 26149 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 00:21:22.624606 26166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:22.626526 26149 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:21:22.626765 26149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "2032db1dcec4456783180ee086ed6940"
format_stamp: "Formatted at 2026-08-12 00:21:22 on dist-test-slave-njxd"
server_key: "5aeed8a825919957df0dd24b67f89ecd"
server_key_iv: "24a0c7e7a750ba75496f08b903b6d28f"
server_key_version: "encryptionkey@0"
I20260812 00:21:22.627063 26149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:22.640014 26149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:22.644331 26149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:22.644680 26149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:22.645831 26149 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:22.647393 26149 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:22.647504 26149 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:22.647668 26149 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:22.647746 26149 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:22.684751 26149 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:46795
I20260812 00:21:22.684785 26293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:46795 every 8 connection(s)
I20260812 00:21:22.686314 26149 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:21:22.694778 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 26149
I20260812 00:21:22.695039 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:21:22.695717 19087 external_mini_cluster.cc:1428] Setting key 70c4f2820fbbb37df527f8614dd2b4e7
Aug 12 00:21:22 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494082, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM
I20260812 00:21:22.709260 26296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:22.689078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:47729 (local address 127.18.163.254:35307)
0812 00:21:22.689542 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:22.689546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:22.690483 (+ 937us) server_negotiation.cc:407] Connection header received
0812 00:21:22.692399 (+ 1916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:22.692405 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:22.692505 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:22.692630 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:22.694342 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:22.695200 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:22.697173 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:22.697818 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:22.697962 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:22.701891 (+ 3929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:22.701901 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:22.701908 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:22.701957 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:22.705619 (+ 3662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:22.706505 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:22.706513 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:22.706520 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:22.706687 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:22.707124 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:22.707131 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:22.707137 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:22.707555 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:22.707721 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:22.708460 (+ 739us) server_negotiation.cc:299] Negotiation successful
0812 00:21:22.708737 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":361,"thread_start_us":244,"threads_started":1}
I20260812 00:21:22.710112 26297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:22.689540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.193:47729)
0812 00:21:22.690317 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:22.690358 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:22.692091 (+ 1733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:22.692889 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:22.692898 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:22.693462 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:22.694144 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:22.694163 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:22.695378 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:22.695382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:22.696995 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:22.697019 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:22.698062 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:22.698068 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:22.698298 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:22.699043 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:22.699067 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:22.701632 (+ 2565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:22.705811 (+ 4179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:22.705819 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:22.705834 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:22.706347 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:22.706800 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:22.706803 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:22.706806 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:22.707002 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:22.707683 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:22.707689 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:22.708044 (+ 355us) client_negotiation.cc:769] Sending connection context
0812 00:21:22.708295 (+ 251us) client_negotiation.cc:240] Negotiation successful
0812 00:21:22.708738 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":288,"threads_started":1}
I20260812 00:21:22.711866 26294 heartbeater.cc:347] Connected to a master server at 127.18.163.254:35307
I20260812 00:21:22.712234 26294 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:22.713158 26294 heartbeater.cc:511] Master 127.18.163.254:35307 requested a full tablet report, sending...
I20260812 00:21:22.715618 26080 ts_manager.cc:194] Registered new tserver with Master: 2032db1dcec4456783180ee086ed6940 (127.18.163.193:46795)
I20260812 00:21:22.717195 26080 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:47729
WARNING: no policy specified for oryx/127.18.163.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.163.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.194.keytab.
Entry for principal oryx/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.194.keytab.
I20260812 00:21:22.760394 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:35307
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.194.keytab
--principal=oryx/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:23.131866 26301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:23.132212 26301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:23.132426 26301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:23.140131 26301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:23.140259 26301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:23.140375 26301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:21:23.150759 26301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.194.keytab
--principal=oryx/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:35307
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:23.152192 26301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:23.153734 26301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:23.168187 26307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:23.168114 26308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:23.168140 26310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:23.169039 26301 server_base.cc:1034] running on GCE node
I20260812 00:21:23.169816 26301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:23.170948 26301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:23.172190 26301 hybrid_clock.cc:648] HybridClock initialized: now 1786494083172143 us; error 43 us; skew 500 ppm
I20260812 00:21:23.172554 26301 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:23 dist-test-slave-njxd krb5kdc[26025](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494083, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:23.176024 26301 init.cc:377] Logged in from keytab as oryx/127.18.163.194@KRBTEST.COM (short username oryx)
I20260812 00:21:23.177767 26301 webserver.cc:460] Webserver started at http://127.18.163.194:34297/ using document root <none> and password file <none>
I20260812 00:21:23.178580 26301 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:23.178745 26301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:23.179085 26301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:23.182471 26301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "cf032d1d952d46ceb0695d05b37e8ca1"
format_stamp: "Formatted at 2026-08-12 00:21:23 on dist-test-slave-njxd"
server_key: "c52278536c60f83650093a28213195fd"
server_key_iv: "ebfbb0a5b59083e0cfcc474d4938cc52"
server_key_version: "encryptionkey@0"
I20260812 00:21:23.183339 26301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "cf032d1d952d46ceb0695d05b37e8ca1"
format_stamp: "Formatted at 2026-08-12 00:21:23 on dist-test-slave-njxd"
server_key: "c52278536c60f83650093a28213195fd"
server_key_iv: "ebfbb0a5b59083e0cfcc474d4938cc52"
server_key_version: "encryptionkey@0"
I20260812 00:21:23.189177 26301 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 00:21:23.193145 26317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:23.194836 26301 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:21:23.195055 26301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "cf032d1d952d46ceb0695d05b37e8ca1"
format_stamp: "Formatted at 2026-08-12 00:21:23 on dist-test-slave-njxd"
server_key: "c52278536c60f83650093a28213195fd"
server_key_iv: "ebfbb0a5b59083e0cfcc474d4938cc52"
server_key_version: "encryptionkey@0"
I20260812 00:21:23.195302 26301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:23.250540 26301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:23.255448 26301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:23.255820 26301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:23.256953 26301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:23.258566 26301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:23.258684 26301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:23.258855 26301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:23.258931 26301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:23.296232 26301 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:43693
I20260812 00:21:23.296330 26441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:43693 every 8 connection(s)
I20260812 00:21:23.297747 26301 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:21:23.302918 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 26301
I20260812 00:21:23.303164 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:21:23.303608 19087 external_mini_cluster.cc:1428] Setting key ef085279464ad21c7a2310020b1bbfd7
Aug 12 00:21:23 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494083, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM
I20260812 00:21:23.321659 26444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:23.300881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:47645 (local address 127.18.163.254:35307)
0812 00:21:23.301412 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:23.301417 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:23.302572 (+ 1155us) server_negotiation.cc:407] Connection header received
0812 00:21:23.304948 (+ 2376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:23.304953 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:23.305022 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:23.305131 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:23.307230 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:23.308058 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:23.309929 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:23.310385 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:23.310537 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:23.314852 (+ 4315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:23.314858 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:23.314861 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:23.314900 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:23.317866 (+ 2966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:23.318815 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:23.318819 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:23.318822 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:23.318992 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:23.319540 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:23.319544 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:23.319546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:23.319881 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:23.320075 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:23.320940 (+ 865us) server_negotiation.cc:299] Negotiation successful
0812 00:21:23.321218 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":265,"threads_started":1}
I20260812 00:21:23.322816 26445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:23.301524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.194:47645)
0812 00:21:23.302384 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:23.302434 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:23.304609 (+ 2175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:23.305472 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:23.305485 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:23.306341 (+ 856us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:23.306994 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:23.307014 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:23.308254 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:23.308258 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:23.309750 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:23.309765 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:23.310653 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:23.310660 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:23.310938 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:23.311750 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:23.311774 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:23.314495 (+ 2721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:23.318075 (+ 3580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:23.318093 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:23.318112 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:23.318644 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:23.319125 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:23.319131 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:23.319135 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:23.319392 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:23.320052 (+ 660us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:23.320062 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:23.320519 (+ 457us) client_negotiation.cc:769] Sending connection context
0812 00:21:23.320825 (+ 306us) client_negotiation.cc:240] Negotiation successful
0812 00:21:23.321517 (+ 692us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":309,"threads_started":1}
I20260812 00:21:23.324594 26442 heartbeater.cc:347] Connected to a master server at 127.18.163.254:35307
I20260812 00:21:23.324980 26442 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:23.326126 26442 heartbeater.cc:511] Master 127.18.163.254:35307 requested a full tablet report, sending...
I20260812 00:21:23.328079 26080 ts_manager.cc:194] Registered new tserver with Master: cf032d1d952d46ceb0695d05b37e8ca1 (127.18.163.194:43693)
I20260812 00:21:23.329499 26080 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:47645
WARNING: no policy specified for oryx/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.195.keytab.
Entry for principal oryx/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.195.keytab.
I20260812 00:21:23.374159 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:35307
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.195.keytab
--principal=oryx/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:21:23.721338 26294 heartbeater.cc:503] Master 127.18.163.254:35307 was elected leader, sending a full tablet report...
W20260812 00:21:23.748241 26448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:23.748586 26448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:23.748775 26448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:23.756814 26448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:23.756950 26448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:23.757143 26448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:21:23.768327 26448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.195.keytab
--principal=oryx/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:35307
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:23.769871 26448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:23.771528 26448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:23.789137 26458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:23.789162 26456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:23.789970 26455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:23.790052 26448 server_base.cc:1034] running on GCE node
I20260812 00:21:23.790938 26448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:23.792003 26448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:23.793264 26448 hybrid_clock.cc:648] HybridClock initialized: now 1786494083793208 us; error 50 us; skew 500 ppm
I20260812 00:21:23.793697 26448 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:23 dist-test-slave-njxd krb5kdc[26025](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494083, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:23.797304 26448 init.cc:377] Logged in from keytab as oryx/127.18.163.195@KRBTEST.COM (short username oryx)
I20260812 00:21:23.799125 26448 webserver.cc:460] Webserver started at http://127.18.163.195:43637/ using document root <none> and password file <none>
I20260812 00:21:23.800021 26448 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:23.800137 26448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:23.800414 26448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:23.803632 26448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "bbed97135e09454083b90c16e90b7475"
format_stamp: "Formatted at 2026-08-12 00:21:23 on dist-test-slave-njxd"
server_key: "b15cadf35afee6c0a153a4a13a0b4e40"
server_key_iv: "e3ab7801014bd0731c4f60e5132574b7"
server_key_version: "encryptionkey@0"
I20260812 00:21:23.804438 26448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "bbed97135e09454083b90c16e90b7475"
format_stamp: "Formatted at 2026-08-12 00:21:23 on dist-test-slave-njxd"
server_key: "b15cadf35afee6c0a153a4a13a0b4e40"
server_key_iv: "e3ab7801014bd0731c4f60e5132574b7"
server_key_version: "encryptionkey@0"
I20260812 00:21:23.810338 26448 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260812 00:21:23.814414 26465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:23.815995 26448 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.003s
I20260812 00:21:23.816156 26448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "bbed97135e09454083b90c16e90b7475"
format_stamp: "Formatted at 2026-08-12 00:21:23 on dist-test-slave-njxd"
server_key: "b15cadf35afee6c0a153a4a13a0b4e40"
server_key_iv: "e3ab7801014bd0731c4f60e5132574b7"
server_key_version: "encryptionkey@0"
I20260812 00:21:23.816360 26448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:23.830412 26448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:23.835101 26448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:23.835458 26448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:23.836485 26448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:23.838047 26448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:23.838131 26448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:23.838236 26448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:23.838284 26448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:23.874281 26448 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:46691
I20260812 00:21:23.874330 26595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:46691 every 8 connection(s)
I20260812 00:21:23.875763 26448 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:21:23.876331 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 26448
I20260812 00:21:23.876572 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:21:23.877197 19087 external_mini_cluster.cc:1428] Setting key 9b7687d970d4ccea8b798e8b1021646a
Aug 12 00:21:23 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494083, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM
I20260812 00:21:23.898620 26599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:23.880253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:57027 (local address 127.18.163.254:35307)
0812 00:21:23.880778 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:23.880786 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:23.880806 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:21:23.883064 (+ 2258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:23.883070 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:23.883174 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:23.883300 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:23.884992 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:23.885913 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:23.887732 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:23.888329 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:23.888482 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:23.892563 (+ 4081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:23.892569 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:23.892572 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:23.892610 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:23.895617 (+ 3007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:23.896404 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:23.896408 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:23.896410 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:23.896535 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:23.896948 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:23.896951 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:23.896953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:23.897225 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:23.897353 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:23.898142 (+ 789us) server_negotiation.cc:299] Negotiation successful
0812 00:21:23.898338 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":968,"threads_started":1}
I20260812 00:21:23.899792 26598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:23.879711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.195:57027)
0812 00:21:23.880667 (+ 956us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:23.880722 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:23.882761 (+ 2039us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:23.883575 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:23.883585 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:23.884156 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:23.884797 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:23.884817 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:23.886093 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:23.886097 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:23.887532 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:23.887545 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:23.888631 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:23.888646 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:23.888909 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:23.889676 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:23.889706 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:23.892294 (+ 2588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:23.895774 (+ 3480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:23.895782 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:23.895797 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:23.896290 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:23.896632 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:23.896635 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:23.896637 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:23.896847 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:23.897339 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:23.897346 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:23.897769 (+ 423us) client_negotiation.cc:769] Sending connection context
0812 00:21:23.898044 (+ 275us) client_negotiation.cc:240] Negotiation successful
0812 00:21:23.898492 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":565,"threads_started":1}
I20260812 00:21:23.901423 26596 heartbeater.cc:347] Connected to a master server at 127.18.163.254:35307
I20260812 00:21:23.901811 26596 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:23.902635 26596 heartbeater.cc:511] Master 127.18.163.254:35307 requested a full tablet report, sending...
I20260812 00:21:23.904311 26080 ts_manager.cc:194] Registered new tserver with Master: bbed97135e09454083b90c16e90b7475 (127.18.163.195:46691)
I20260812 00:21:23.905484 26080 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:57027
I20260812 00:21:23.906646 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.18.163.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.163.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.163.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.253.keytab.
Entry for principal oryx/127.18.163.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.253.keytab.
I20260812 00:21:23.975585 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.253:39737
--webserver_interface=127.18.163.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.253.keytab
--principal=oryx/127.18.163.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:35307,127.18.163.253:39737
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:21:24.333685 26442 heartbeater.cc:503] Master 127.18.163.254:35307 was elected leader, sending a full tablet report...
W20260812 00:21:24.344110 26603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:24.344426 26603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:24.344522 26603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:24.352188 26603 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:21:24.352334 26603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:24.352382 26603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:24.352442 26603 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:21:24.352487 26603 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:21:24.363687 26603 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:35307,127.18.163.253:39737
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.253.keytab
--principal=oryx/127.18.163.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.253:39737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.163.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
W20260812 00:21:24.364180 26603 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.18.163.254:35307,127.18.163.253:39737'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 00:21:24.365454 26603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:24.367008 26603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:24.380034 26610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:24.380000 26611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:24.379952 26613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:24.381285 26603 server_base.cc:1034] running on GCE node
I20260812 00:21:24.382252 26603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:24.384027 26603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:24.385281 26603 hybrid_clock.cc:648] HybridClock initialized: now 1786494084385224 us; error 44 us; skew 500 ppm
I20260812 00:21:24.385700 26603 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:24 dist-test-slave-njxd krb5kdc[26025](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494084, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:24.393996 26603 init.cc:377] Logged in from keytab as oryx/127.18.163.253@KRBTEST.COM (short username oryx)
I20260812 00:21:24.395825 26603 webserver.cc:460] Webserver started at http://127.18.163.253:38809/ using document root <none> and password file <none>
I20260812 00:21:24.396672 26603 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:24.396833 26603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:24.397197 26603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:24.400849 26603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/data/instance:
uuid: "a10addcd04f8412b83702e3dd63daaf9"
format_stamp: "Formatted at 2026-08-12 00:21:24 on dist-test-slave-njxd"
server_key: "eb4c0034445f40e7ed9826f28d27e2c5"
server_key_iv: "ba83f7f22ce7ebd9888283bd91e05af2"
server_key_version: "encryptionkey@0"
I20260812 00:21:24.401861 26603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/wal/instance:
uuid: "a10addcd04f8412b83702e3dd63daaf9"
format_stamp: "Formatted at 2026-08-12 00:21:24 on dist-test-slave-njxd"
server_key: "eb4c0034445f40e7ed9826f28d27e2c5"
server_key_iv: "ba83f7f22ce7ebd9888283bd91e05af2"
server_key_version: "encryptionkey@0"
I20260812 00:21:24.407892 26603 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:21:24.411948 26622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:24.413497 26603 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:21:24.413767 26603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/wal
uuid: "a10addcd04f8412b83702e3dd63daaf9"
format_stamp: "Formatted at 2026-08-12 00:21:24 on dist-test-slave-njxd"
server_key: "eb4c0034445f40e7ed9826f28d27e2c5"
server_key_iv: "ba83f7f22ce7ebd9888283bd91e05af2"
server_key_version: "encryptionkey@0"
I20260812 00:21:24.414024 26603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:24.442878 26603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:24.447839 26603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:24.448158 26603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:24.468071 26603 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.253:39737
I20260812 00:21:24.468093 26678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.253:39737 every 8 connection(s)
I20260812 00:21:24.469565 26603 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/data/info.pb
I20260812 00:21:24.473753 26679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:24.476855 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 26603
I20260812 00:21:24.482477 26679 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:21:24 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.163.253@KRBTEST.COM
Aug 12 00:21:24 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494084, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.253@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM
I20260812 00:21:24.501523 26683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:24.479698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34478 (local address 127.18.163.253:39737)
0812 00:21:24.480568 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:24.480581 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:24.480628 (+ 47us) server_negotiation.cc:407] Connection header received
0812 00:21:24.482467 (+ 1839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:24.482494 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:24.482944 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:24.483343 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:24.485291 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.487233 (+ 1942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.488532 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.489228 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.489450 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:24.493933 (+ 4483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:24.493944 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:24.493963 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:24.494002 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:24.497047 (+ 3045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:24.497798 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:24.497804 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:24.497812 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:24.497969 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:24.498439 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:24.498444 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:24.498451 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:24.499049 (+ 598us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:24.499288 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:24.499953 (+ 665us) server_negotiation.cc:299] Negotiation successful
0812 00:21:24.500411 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":407,"threads_started":1}
I20260812 00:21:24.502697 26684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:24.485455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57382 (local address 127.18.163.254:35307)
0812 00:21:24.486057 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:24.486066 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:24.486519 (+ 453us) server_negotiation.cc:407] Connection header received
0812 00:21:24.486741 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:24.486752 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:24.486831 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:24.486950 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:24.488187 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.488944 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.490608 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.491017 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.491169 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:24.495325 (+ 4156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:24.495330 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:24.495334 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:24.495373 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:24.499235 (+ 3862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:24.500346 (+ 1111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:24.500352 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:24.500355 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:24.500495 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:24.500933 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:24.500939 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:24.500942 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:24.501294 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:24.501467 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:24.502050 (+ 583us) server_negotiation.cc:299] Negotiation successful
0812 00:21:24.502318 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":310,"threads_started":1}
I20260812 00:21:24.502760 26685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:24.485413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.0.0.1:57382)
0812 00:21:24.486376 (+ 963us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:24.486418 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:24.486607 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:24.487025 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:24.487032 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:24.487760 (+ 728us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:24.488021 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:24.488030 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.489087 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.489093 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:24.490455 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:24.490468 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.491273 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.491281 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:24.491437 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:24.492078 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:24.492109 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:24.495091 (+ 2982us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:24.499371 (+ 4280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:24.499381 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:24.499389 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:24.500153 (+ 764us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:24.500647 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:24.500651 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:24.500653 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:24.500800 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:24.501441 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:24.501450 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:24.501716 (+ 266us) client_negotiation.cc:769] Sending connection context
0812 00:21:24.501935 (+ 219us) client_negotiation.cc:240] Negotiation successful
0812 00:21:24.502307 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":751,"thread_start_us":562,"threads_started":1}
I20260812 00:21:24.506263 26679 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:21:24 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494084, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.253@KRBTEST.COM for oryx/127.18.163.253@KRBTEST.COM
I20260812 00:21:24.519032 26685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:24.507076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39737 (local address 127.0.0.1:34488)
0812 00:21:24.507276 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:24.507296 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:24.507405 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:24.507668 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:24.507679 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:24.508032 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:24.508179 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:24.508187 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.509124 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.509128 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:24.510094 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:24.510106 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.510770 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.510774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:24.510924 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:24.511481 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:24.511499 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:24.513562 (+ 2063us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:24.516576 (+ 3014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:24.516580 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:24.516583 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:24.516964 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:24.517395 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:24.517399 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:24.517404 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:24.517546 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:24.518157 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:24.518192 (+ 35us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:24.518346 (+ 154us) client_negotiation.cc:769] Sending connection context
0812 00:21:24.518455 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 00:21:24.518747 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 00:21:24.519202 26683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:24.507064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34488 (local address 127.18.163.253:39737)
0812 00:21:24.507237 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:24.507242 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:24.507367 (+ 125us) server_negotiation.cc:407] Connection header received
0812 00:21:24.507495 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:24.507498 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:24.507555 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:24.507634 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:24.508301 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.508992 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.510228 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.510644 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.510748 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:24.513816 (+ 3068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:24.513821 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:24.513824 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:24.513854 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:24.516444 (+ 2590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:24.517094 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:24.517099 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:24.517101 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:24.517256 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:24.517724 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:24.517727 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:24.517729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:24.518049 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:24.518164 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:24.518573 (+ 409us) server_negotiation.cc:299] Negotiation successful
0812 00:21:24.518904 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":120,"server-negotiator.queue_time_us":56}
I20260812 00:21:24.524363 26679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: Bootstrap starting.
I20260812 00:21:24.527808 26679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:24.528964 26679 log.cc:824] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:24.532155 26679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: No bootstrap required, opened a new log
I20260812 00:21:24.539710 26679 raft_consensus.cc:348] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } }
I20260812 00:21:24.540125 26679 raft_consensus.cc:374] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:24.540231 26679 raft_consensus.cc:729] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10addcd04f8412b83702e3dd63daaf9, State: Initialized, Role: FOLLOWER
I20260812 00:21:24.540879 26679 consensus_queue.cc:260] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } }
I20260812 00:21:24.541862 26687 sys_catalog.cc:455] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } } }
I20260812 00:21:24.542232 26687 sys_catalog.cc:458] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:21:24.543038 26679 sys_catalog.cc:564] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 00:21:24.552544 26699 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:21:24.552732 26699 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:21:24.556305 26603 master_runner.cc:428] Detected that this master a10addcd04f8412b83702e3dd63daaf9 is joining an existing cluster
I20260812 00:21:24.556445 26603 master_runner.cc:432] Initiating AddMaster RPC to add 127.18.163.253:39737
WARNING: no policy specified for oryx/127.18.163.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.163.252@KRBTEST.COM" created.
I20260812 00:21:24.596264 26683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:24.566002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34496 (local address 127.18.163.253:39737)
0812 00:21:24.566256 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:24.566263 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:24.579141 (+ 12878us) server_negotiation.cc:407] Connection header received
0812 00:21:24.579422 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:24.579432 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:24.579531 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:24.579606 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:24.581841 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.583012 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.585174 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.585907 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.586019 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:24.589036 (+ 3017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:24.589043 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:24.589050 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:24.589098 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:24.592906 (+ 3808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:24.593797 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:24.593803 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:24.593808 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:24.594116 (+ 308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:24.594598 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:24.594603 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:24.594606 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:24.594927 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:24.595112 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:24.595484 (+ 372us) server_negotiation.cc:299] Negotiation successful
0812 00:21:24.595867 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":162,"server-negotiator.queue_time_us":59,"spinlock_wait_cycles":9984}
I20260812 00:21:24.596293 26706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:24.565185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39737 (local address 127.0.0.1:34496)
0812 00:21:24.578998 (+ 13813us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:24.579025 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:24.579275 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:24.579853 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:24.579858 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:24.580959 (+ 1101us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:24.581651 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:24.581666 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.583255 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.583261 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:24.584986 (+ 1725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:24.585001 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.586392 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.586400 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:24.586588 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:24.587336 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:24.587390 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:24.588819 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:24.593147 (+ 4328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:24.593152 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:24.593157 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:24.593638 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:24.594251 (+ 613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:24.594259 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:24.594266 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:24.594448 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:24.595044 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:24.595049 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:24.595228 (+ 179us) client_negotiation.cc:769] Sending connection context
0812 00:21:24.595377 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 00:21:24.595718 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13682,"mutex_wait_us":102,"thread_start_us":12845,"threads_started":1}
I20260812 00:21:24.604380 26684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:24.566271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57384 (local address 127.18.163.254:35307)
0812 00:21:24.566519 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:24.566529 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:24.579153 (+ 12624us) server_negotiation.cc:407] Connection header received
0812 00:21:24.579443 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:24.579449 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:24.579592 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:24.579668 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:24.581871 (+ 2203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.583003 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.585478 (+ 2475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.586202 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.586305 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:24.589070 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:24.589077 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:24.589082 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:24.589124 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:24.593710 (+ 4586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:24.602029 (+ 8319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:24.602036 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:24.602039 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:24.602249 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:24.602728 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:24.602733 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:24.602735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:24.603061 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:24.603252 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:24.603704 (+ 452us) server_negotiation.cc:299] Negotiation successful
0812 00:21:24.603992 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 00:21:24.604773 26705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:24.565153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.0.0.1:57384)
0812 00:21:24.578999 (+ 13846us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:24.579025 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:24.579281 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:24.579867 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:24.579874 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:24.580959 (+ 1085us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:24.581662 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:24.581670 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.583692 (+ 2022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.583698 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:24.585316 (+ 1618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:24.585328 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.586638 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.586647 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:24.586833 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:24.587567 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:24.587598 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:24.588819 (+ 1221us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:24.593932 (+ 5113us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:24.593937 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:24.593944 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:24.601837 (+ 7893us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:24.602387 (+ 550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:24.602398 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:24.602400 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:24.602565 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:24.603209 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:24.603214 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:24.603419 (+ 205us) client_negotiation.cc:769] Sending connection context
0812 00:21:24.603579 (+ 160us) client_negotiation.cc:240] Negotiation successful
0812 00:21:24.603954 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13101,"mutex_wait_us":46,"spinlock_wait_cycles":83968,"thread_start_us":13491,"threads_started":1}
Aug 12 00:21:24 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494081, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.254@KRBTEST.COM for oryx/127.18.163.253@KRBTEST.COM
I20260812 00:21:24.634589 26710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:24.611883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39737 (local address 127.0.0.1:34500)
0812 00:21:24.617997 (+ 6114us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:24.618048 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:24.618369 (+ 321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:24.619092 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:24.619103 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:24.619999 (+ 896us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:24.620249 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:24.620260 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.621466 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.621473 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:24.622622 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:24.622636 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.623450 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.623456 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:24.623653 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:24.624343 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:24.624367 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:24.626738 (+ 2371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:24.630605 (+ 3867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:24.630623 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:24.630632 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:24.631297 (+ 665us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:24.631780 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:24.631785 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:24.631789 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:24.632056 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:24.633036 (+ 980us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:24.633047 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:24.633371 (+ 324us) client_negotiation.cc:769] Sending connection context
0812 00:21:24.633649 (+ 278us) client_negotiation.cc:240] Negotiation successful
0812 00:21:24.634093 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5750,"thread_start_us":5547,"threads_started":1}
I20260812 00:21:24.635586 26683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:24.611823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34500 (local address 127.18.163.253:39737)
0812 00:21:24.612057 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:24.612067 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:24.618172 (+ 6105us) server_negotiation.cc:407] Connection header received
0812 00:21:24.618660 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:24.618664 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:24.618767 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:24.618908 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:24.620420 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.621328 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.622781 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.623265 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.623407 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:24.626967 (+ 3560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:24.626972 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:24.626976 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:24.627018 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:24.630423 (+ 3405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:24.631470 (+ 1047us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:24.631475 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:24.631477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:24.631643 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:24.632237 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:24.632241 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:24.632243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:24.632775 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:24.632946 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:24.634993 (+ 2047us) server_negotiation.cc:299] Negotiation successful
0812 00:21:24.635329 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260812 00:21:24.637686 26080 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.18.163.253:39737: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9"
member_type: NON_VOTER
last_known_addr {
host: "127.18.163.253"
port: 39737
}
attrs {
promote: true
}
}
dest_uuid: "16e941ca289a44a9a99608abd9bb8230"
cas_config_opid_index: -1
I20260812 00:21:24.638888 26080 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: NON_VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: true } }
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.163.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.252.keytab.
Entry for principal oryx/127.18.163.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.252.keytab.
I20260812 00:21:24.641335 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.252:40263
--webserver_interface=127.18.163.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.252.keytab
--principal=oryx/127.18.163.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:35307,127.18.163.253:39737,127.18.163.252:40263
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:21:24.653889 26712 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER a10addcd04f8412b83702e3dd63daaf9 (127.18.163.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: NON_VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: true } } }
I20260812 00:21:24.655766 26653 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:24.658180 26712 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.18.163.253:39737
I20260812 00:21:24.658936 26713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "16e941ca289a44a9a99608abd9bb8230" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: NON_VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: true } } }
I20260812 00:21:24.659304 26603 master.cc:537] Master@127.18.163.253:39737 shutting down...
I20260812 00:21:24.659507 26713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:24.661216 26653 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 1 FOLLOWER]: Refusing update from remote peer 16e941ca289a44a9a99608abd9bb8230: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 00:21:24.666900 26713 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: NON_VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 00:21:24.671833 26059 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260812 00:21:24.679375 26603 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:24.680068 26603 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:24.680326 26603 tablet_replica.cc:330] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: stopping tablet replica
W20260812 00:21:24.682817 26059 consensus_peers.cc:487] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 -> Peer a10addcd04f8412b83702e3dd63daaf9 (127.18.163.253:39737): Couldn't send request to peer a10addcd04f8412b83702e3dd63daaf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 00:21:24.689742 26603 master.cc:552] Master@127.18.163.253:39737 shutdown complete.
I20260812 00:21:24.689903 26603 master_runner.cc:305] Clearing existing system tablet
I20260812 00:21:24.690409 26603 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:24.690516 26603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:24.693966 26603 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260812 00:21:24.695930 26718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:24.696360 26603 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:24.696658 26603 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260812 00:21:24.696745 26603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/wal
uuid: "a10addcd04f8412b83702e3dd63daaf9"
format_stamp: "Formatted at 2026-08-12 00:21:24 on dist-test-slave-njxd"
server_key: "eb4c0034445f40e7ed9826f28d27e2c5"
server_key_iv: "ba83f7f22ce7ebd9888283bd91e05af2"
server_key_version: "encryptionkey@0"
I20260812 00:21:24.702101 26603 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:24.709462 26603 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 00:21:24.709731 26603 log.cc:1196] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 00:21:24.710220 26603 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: Deleting consensus metadata
I20260812 00:21:24.710520 26603 master_runner.cc:315] Copying system tablet from 127.18.163.254:35307
I20260812 00:21:24.713392 26603 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: tablet copy: Beginning tablet copy session from remote peer at address 127.18.163.254:35307
I20260812 00:21:24.733630 26684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:24.714418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57392 (local address 127.18.163.254:35307)
0812 00:21:24.714651 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:24.714658 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:24.718226 (+ 3568us) server_negotiation.cc:407] Connection header received
0812 00:21:24.718466 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:24.718474 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:24.718587 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:24.718743 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:24.719910 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.721099 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.723018 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.723728 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.723863 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:24.726575 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:24.726582 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:24.726586 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:24.726629 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:24.730228 (+ 3599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:24.731119 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:24.731175 (+ 56us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:24.731178 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:24.731348 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:24.731864 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:24.731870 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:24.731872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:24.732321 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:24.732477 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:24.732985 (+ 508us) server_negotiation.cc:299] Negotiation successful
0812 00:21:24.733228 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 00:21:24.733734 26728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:24.714378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.0.0.1:57392)
0812 00:21:24.718050 (+ 3672us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:24.718075 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:24.718273 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:24.718780 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:24.718786 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:24.719395 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:24.719708 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:24.719722 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.721304 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.721309 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:24.722831 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:24.722849 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:24.724128 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:24.724134 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:24.724326 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:24.725099 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:24.725125 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:24.726333 (+ 1208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:24.730402 (+ 4069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:24.730408 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:24.730412 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:24.730990 (+ 578us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:24.731477 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:24.731485 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:24.731493 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:24.731685 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:24.732449 (+ 764us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:24.732455 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:24.732665 (+ 210us) client_negotiation.cc:769] Sending connection context
0812 00:21:24.732820 (+ 155us) client_negotiation.cc:240] Negotiation successful
0812 00:21:24.733203 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3492,"thread_start_us":3373,"threads_started":1}
I20260812 00:21:24.735045 26104 tablet_copy_service.cc:140] P 16e941ca289a44a9a99608abd9bb8230: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a10addcd04f8412b83702e3dd63daaf9 ({username='oryx', principal='oryx/127.18.163.253@KRBTEST.COM'} at 127.0.0.1:57392)
I20260812 00:21:24.735373 26104 tablet_copy_service.cc:161] P 16e941ca289a44a9a99608abd9bb8230: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a10addcd04f8412b83702e3dd63daaf9 at {username='oryx', principal='oryx/127.18.163.253@KRBTEST.COM'} at 127.0.0.1:57392: session id = a10addcd04f8412b83702e3dd63daaf9-00000000000000000000000000000000
I20260812 00:21:24.740010 26104 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 00:21:24.742715 26603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 00:21:24.750598 26603 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: tablet copy: Starting download of 0 data blocks...
I20260812 00:21:24.751016 26603 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: tablet copy: Starting download of 1 WAL segments...
I20260812 00:21:24.754565 26603 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 00:21:24.760248 26104 tablet_copy_service.cc:342] P 16e941ca289a44a9a99608abd9bb8230: Request end of tablet copy session a10addcd04f8412b83702e3dd63daaf9-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.18.163.253@KRBTEST.COM'} at 127.0.0.1:57392
I20260812 00:21:24.760617 26104 tablet_copy_service.cc:433] P 16e941ca289a44a9a99608abd9bb8230: ending tablet copy session a10addcd04f8412b83702e3dd63daaf9-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a10addcd04f8412b83702e3dd63daaf9
I20260812 00:21:24.773624 26603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:24.776733 26729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:24.783052 26730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:24.793896 26603 server_base.cc:1034] running on GCE node
W20260812 00:21:24.795198 26732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:24.795848 26603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:24.796623 26603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:24.797863 26603 hybrid_clock.cc:648] HybridClock initialized: now 1786494084797779 us; error 52 us; skew 500 ppm
I20260812 00:21:24.798127 26603 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:24 dist-test-slave-njxd krb5kdc[26025](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494084, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:24.800619 26603 init.cc:377] Logged in from keytab as oryx/127.18.163.253@KRBTEST.COM (short username oryx)
I20260812 00:21:24.806777 26603 webserver.cc:460] Webserver started at http://127.18.163.253:34233/ using document root <none> and password file <none>
I20260812 00:21:24.807222 26603 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:24.807317 26603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:24.810814 26603 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 00:21:24.813069 26739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:24.813567 26603 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 00:21:24.813764 26603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/wal
uuid: "a10addcd04f8412b83702e3dd63daaf9"
format_stamp: "Formatted at 2026-08-12 00:21:24 on dist-test-slave-njxd"
server_key: "eb4c0034445f40e7ed9826f28d27e2c5"
server_key_iv: "ba83f7f22ce7ebd9888283bd91e05af2"
server_key_version: "encryptionkey@0"
I20260812 00:21:24.813958 26603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:24.830648 26603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:24.835264 26603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:24.887379 26603 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.253:39737
I20260812 00:21:24.887405 26798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.253:39737 every 8 connection(s)
I20260812 00:21:24.888523 26603 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-1/data/info.pb
I20260812 00:21:24.894048 26799 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:21:24.899323 26799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: Bootstrap starting.
I20260812 00:21:24.908463 26596 heartbeater.cc:503] Master 127.18.163.254:35307 was elected leader, sending a full tablet report...
I20260812 00:21:24.919768 26799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:21:24.920403 26799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: Bootstrap complete.
I20260812 00:21:24.921833 26799 raft_consensus.cc:348] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: NON_VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: true } }
I20260812 00:21:24.922192 26799 raft_consensus.cc:729] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a10addcd04f8412b83702e3dd63daaf9, State: Initialized, Role: LEARNER
I20260812 00:21:24.922606 26799 consensus_queue.cc:260] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: NON_VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: true } }
I20260812 00:21:24.923704 26802 sys_catalog.cc:455] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: NON_VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: true } } }
I20260812 00:21:24.924165 26802 sys_catalog.cc:458] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: This master's current role is: LEARNER
I20260812 00:21:24.924234 26799 sys_catalog.cc:564] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:21:24.934793 26816 catalog_manager.cc:1259] Loaded cluster ID: 948a8bfb8dc64a31b2e6944f04b6502d
I20260812 00:21:24.934930 26816 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: loading cluster ID for follower catalog manager: success
I20260812 00:21:24.939059 26816 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: acquiring CA information for follower catalog manager: success
I20260812 00:21:24.942138 26816 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 00:21:25.093056 26714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:25.093362 26714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:25.093532 26714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:25.101421 26714 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:21:25.101619 26714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:25.101737 26714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:25.101845 26714 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:21:25.101912 26714 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:21:25.112733 26714 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:35307,127.18.163.253:39737,127.18.163.252:40263
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.252.keytab
--principal=oryx/127.18.163.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.252:40263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.163.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:25.114370 26714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:25.115877 26714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:25.128474 26821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:25.128518 26824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:25.128918 26822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:25.129702 26714 server_base.cc:1034] running on GCE node
I20260812 00:21:25.130509 26714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:25.132207 26714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:25.133458 26714 hybrid_clock.cc:648] HybridClock initialized: now 1786494085133391 us; error 56 us; skew 500 ppm
I20260812 00:21:25.133893 26714 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:25 dist-test-slave-njxd krb5kdc[26025](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494085, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:25.137435 26714 init.cc:377] Logged in from keytab as oryx/127.18.163.252@KRBTEST.COM (short username oryx)
I20260812 00:21:25.139222 26714 webserver.cc:460] Webserver started at http://127.18.163.252:43233/ using document root <none> and password file <none>
I20260812 00:21:25.139963 26714 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:25.140074 26714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:25.140353 26714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:25.143754 26714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/data/instance:
uuid: "847e3ad1da2e49528bcecb9b8e3fd11e"
format_stamp: "Formatted at 2026-08-12 00:21:25 on dist-test-slave-njxd"
server_key: "68032d1374fdba9431378de96f9db958"
server_key_iv: "fdd912496abcb3195e9ae293a347fdea"
server_key_version: "encryptionkey@0"
I20260812 00:21:25.144590 26714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/wal/instance:
uuid: "847e3ad1da2e49528bcecb9b8e3fd11e"
format_stamp: "Formatted at 2026-08-12 00:21:25 on dist-test-slave-njxd"
server_key: "68032d1374fdba9431378de96f9db958"
server_key_iv: "fdd912496abcb3195e9ae293a347fdea"
server_key_version: "encryptionkey@0"
I20260812 00:21:25.150458 26714 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 00:21:25.154327 26831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:25.155857 26714 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:21:25.156057 26714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/wal
uuid: "847e3ad1da2e49528bcecb9b8e3fd11e"
format_stamp: "Formatted at 2026-08-12 00:21:25 on dist-test-slave-njxd"
server_key: "68032d1374fdba9431378de96f9db958"
server_key_iv: "fdd912496abcb3195e9ae293a347fdea"
server_key_version: "encryptionkey@0"
I20260812 00:21:25.156282 26714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:25.175678 26714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:25.180795 26714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:25.181103 26714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:25.203739 26714 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.252:40263
I20260812 00:21:25.203752 26896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.252:40263 every 8 connection(s)
I20260812 00:21:25.205440 26714 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/data/info.pb
I20260812 00:21:25.206549 26885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.197974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34502 (local address 127.18.163.253:39737)
0812 00:21:25.199228 (+ 1254us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:25.199234 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:25.199256 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:21:25.199343 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:25.199349 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:25.199458 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:25.199657 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:25.200341 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.201775 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.204353 (+ 2578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.205317 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.205474 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.205722 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:25.206036 (+ 314us) server_negotiation.cc:299] Negotiation successful
0812 00:21:25.206150 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1087,"thread_start_us":951,"threads_started":1}
I20260812 00:21:25.206612 26880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.197700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39737 (local address 127.0.0.1:34502)
0812 00:21:25.198376 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:25.198412 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:25.198629 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:25.199740 (+ 1111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:25.199749 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:25.199812 (+ 63us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:25.200108 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.200126 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.201931 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.201939 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.204153 (+ 2214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.204175 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.205555 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.205562 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.205796 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.205876 (+ 80us) client_negotiation.cc:769] Sending connection context
0812 00:21:25.206012 (+ 136us) client_negotiation.cc:240] Negotiation successful
0812 00:21:25.206194 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":406,"threads_started":1}
I20260812 00:21:25.207989 26772 raft_consensus.cc:1203] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260812 00:21:25.208624 26802 sys_catalog.cc:455] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16e941ca289a44a9a99608abd9bb8230. Latest consensus state: current_term: 1 leader_uuid: "16e941ca289a44a9a99608abd9bb8230" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: NON_VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: true } } }
I20260812 00:21:25.208938 26802 sys_catalog.cc:458] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: This master's current role is: LEARNER
I20260812 00:21:25.210844 26897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:25.215379 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 26714
I20260812 00:21:25.219563 26897 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:21:25 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.163.252@KRBTEST.COM
Aug 12 00:21:25 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494085, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.252@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM
I20260812 00:21:25.243304 26684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.224204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57406 (local address 127.18.163.254:35307)
0812 00:21:25.224412 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:25.224419 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:25.225347 (+ 928us) server_negotiation.cc:407] Connection header received
0812 00:21:25.225562 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:25.225568 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:25.225752 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:25.225874 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:25.227647 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.228713 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.230784 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.231196 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.231357 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.235814 (+ 4457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:25.235821 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:25.235826 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:25.235878 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:25.239440 (+ 3562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.240536 (+ 1096us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.240541 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.240545 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.240775 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.241288 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.241293 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.241297 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.241705 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:25.241881 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:25.242597 (+ 716us) server_negotiation.cc:299] Negotiation successful
0812 00:21:25.242917 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 00:21:25.244438 26902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.224186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.0.0.1:57406)
0812 00:21:25.225173 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:25.225226 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:25.225426 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:25.225962 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:25.225968 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:25.226982 (+ 1014us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:25.227348 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.227363 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.228874 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.228878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.230620 (+ 1742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.230639 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.231489 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.231497 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.231717 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.232487 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:25.232526 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:25.235558 (+ 3032us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:25.239652 (+ 4094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:25.239667 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:25.239681 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:25.240395 (+ 714us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:25.240919 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:25.240924 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:25.240927 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:25.241162 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:25.241861 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:25.241868 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:25.242121 (+ 253us) client_negotiation.cc:769] Sending connection context
0812 00:21:25.242462 (+ 341us) client_negotiation.cc:240] Negotiation successful
0812 00:21:25.243104 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":709,"mutex_wait_us":4,"thread_start_us":489,"threads_started":1}
I20260812 00:21:25.244458 26901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.217715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44506 (local address 127.18.163.252:40263)
0812 00:21:25.218745 (+ 1030us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:25.218762 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:25.218817 (+ 55us) server_negotiation.cc:407] Connection header received
0812 00:21:25.220862 (+ 2045us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:25.220905 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:25.221559 (+ 654us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:25.222108 (+ 549us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:25.223682 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.225878 (+ 2196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.227913 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.229111 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.229262 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.235399 (+ 6137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:25.235410 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:25.235427 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:25.235464 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:25.239440 (+ 3976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.240543 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.240553 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.240556 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.240776 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.241288 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.241293 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.241297 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.242166 (+ 869us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:25.242477 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:25.242902 (+ 425us) server_negotiation.cc:299] Negotiation successful
0812 00:21:25.243235 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":108,"server-negotiator.queue_time_us":726,"thread_start_us":447,"threads_started":1}
I20260812 00:21:25.246363 26897 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:21:25 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494085, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.252@KRBTEST.COM for oryx/127.18.163.253@KRBTEST.COM
I20260812 00:21:25.260416 26902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.247314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39737 (local address 127.0.0.1:34518)
0812 00:21:25.247510 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:25.247534 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:25.247675 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:25.248075 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:25.248079 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:25.248507 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:25.248664 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.248673 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.249824 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.249828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.250776 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.250787 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.251582 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.251590 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.251787 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.252378 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:25.252395 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:25.254792 (+ 2397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:25.258008 (+ 3216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:25.258012 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:25.258016 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:25.258450 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:25.258822 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:25.258825 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:25.258827 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:25.258963 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:25.259442 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:25.259445 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:25.259650 (+ 205us) client_negotiation.cc:769] Sending connection context
0812 00:21:25.259789 (+ 139us) client_negotiation.cc:240] Negotiation successful
0812 00:21:25.260042 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 00:21:25.260447 26885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.247477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34518 (local address 127.18.163.253:39737)
0812 00:21:25.247666 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:25.247673 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:25.247695 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:21:25.247851 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:25.247855 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:25.247951 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:25.248050 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:25.248825 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.249651 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.250942 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.251389 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.251538 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.255041 (+ 3503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:25.255047 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:25.255050 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:25.255091 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:25.257850 (+ 2759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.258562 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.258566 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.258568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.258711 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.259056 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.259059 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.259061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.259339 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:25.259457 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:25.259888 (+ 431us) server_negotiation.cc:299] Negotiation successful
0812 00:21:25.260151 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 00:21:25.261900 26897 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:21:25 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494085, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.252@KRBTEST.COM for oryx/127.18.163.252@KRBTEST.COM
I20260812 00:21:25.274706 26902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.262608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40263 (local address 127.0.0.1:44522)
0812 00:21:25.262803 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:25.262819 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:25.262905 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:25.263180 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:25.263183 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:25.263556 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:25.263705 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.263713 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.264716 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.264719 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.265727 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.265740 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.266399 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.266404 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.266578 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.267167 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:25.267184 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:25.269270 (+ 2086us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:25.272423 (+ 3153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:25.272427 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:25.272430 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:25.272828 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:25.273182 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:25.273185 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:25.273187 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:25.273340 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:25.273894 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:25.273897 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:25.274023 (+ 126us) client_negotiation.cc:769] Sending connection context
0812 00:21:25.274150 (+ 127us) client_negotiation.cc:240] Negotiation successful
0812 00:21:25.274374 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 00:21:25.274852 26901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.262693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44522 (local address 127.18.163.252:40263)
0812 00:21:25.262871 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:25.262875 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:25.262891 (+ 16us) server_negotiation.cc:407] Connection header received
0812 00:21:25.263000 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:25.263003 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:25.263068 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:25.263146 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:25.263836 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.264568 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.265859 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.266262 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.266366 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.269472 (+ 3106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:25.269477 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:25.269481 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:25.269512 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:25.272271 (+ 2759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.272936 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.272940 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.272942 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.273081 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.273435 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.273438 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.273440 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.273789 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:25.273907 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:25.274240 (+ 333us) server_negotiation.cc:299] Negotiation successful
0812 00:21:25.274529 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":82,"server-negotiator.queue_time_us":76}
I20260812 00:21:25.280189 26897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: Bootstrap starting.
I20260812 00:21:25.283624 26897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:25.284778 26897 log.cc:824] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:25.287937 26897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: No bootstrap required, opened a new log
I20260812 00:21:25.295679 26897 raft_consensus.cc:348] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } }
I20260812 00:21:25.296175 26897 raft_consensus.cc:374] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:25.296343 26897 raft_consensus.cc:729] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847e3ad1da2e49528bcecb9b8e3fd11e, State: Initialized, Role: FOLLOWER
I20260812 00:21:25.297044 26897 consensus_queue.cc:260] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } }
I20260812 00:21:25.298167 26904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } } }
I20260812 00:21:25.298590 26904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:21:25.299611 26897 sys_catalog.cc:564] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [sys.catalog]: configured and running, proceeding with master startup.
W20260812 00:21:25.309374 26917 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:21:25.309553 26917 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:21:25.314628 26714 master_runner.cc:428] Detected that this master 847e3ad1da2e49528bcecb9b8e3fd11e is joining an existing cluster
I20260812 00:21:25.314759 26714 master_runner.cc:432] Initiating AddMaster RPC to add 127.18.163.252:40263
I20260812 00:21:25.339805 26885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.319679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34528 (local address 127.18.163.253:39737)
0812 00:21:25.319865 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:25.319871 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:25.321220 (+ 1349us) server_negotiation.cc:407] Connection header received
0812 00:21:25.321482 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:25.321488 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:25.321609 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:25.321690 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:25.323380 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.324537 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.326891 (+ 2354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.327625 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.327733 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.331469 (+ 3736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:25.331476 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:25.331481 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:25.331543 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:25.335303 (+ 3760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.337005 (+ 1702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.337011 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.337014 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.337196 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.337755 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.337760 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.337764 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.338188 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:25.338324 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:25.339086 (+ 762us) server_negotiation.cc:299] Negotiation successful
0812 00:21:25.339387 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 00:21:25.341034 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.319309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39737 (local address 127.0.0.1:34528)
0812 00:21:25.321097 (+ 1788us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:25.321127 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:25.321322 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:25.321911 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:25.321916 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:25.322758 (+ 842us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:25.323187 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.323201 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.324777 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.324782 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.326702 (+ 1920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.326720 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.328140 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.328148 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.328363 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.329816 (+ 1453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:25.329840 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:25.331213 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:25.335456 (+ 4243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:25.335464 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:25.335474 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:25.336844 (+ 1370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:25.337367 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:25.337373 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:25.337379 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:25.337604 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:25.338436 (+ 832us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:25.338442 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:25.338717 (+ 275us) client_negotiation.cc:769] Sending connection context
0812 00:21:25.340038 (+ 1321us) client_negotiation.cc:240] Negotiation successful
0812 00:21:25.340439 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1657,"mutex_wait_us":52,"spinlock_wait_cycles":880512,"thread_start_us":1300,"threads_started":1}
I20260812 00:21:25.343597 26684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.319588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57410 (local address 127.18.163.254:35307)
0812 00:21:25.319808 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:25.319817 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:25.320842 (+ 1025us) server_negotiation.cc:407] Connection header received
0812 00:21:25.321150 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:25.321156 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:25.321259 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:25.321346 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:25.325172 (+ 3826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.326760 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.329073 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.329798 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.329932 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.333035 (+ 3103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:25.333043 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:25.333048 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:25.333106 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:25.339075 (+ 5969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.340294 (+ 1219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.340301 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.340305 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.340481 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.340995 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.341001 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.341004 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.341899 (+ 895us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:25.342042 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:25.342938 (+ 896us) server_negotiation.cc:299] Negotiation successful
0812 00:21:25.343215 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 00:21:25.344700 26923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.319291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.0.0.1:57410)
0812 00:21:25.320696 (+ 1405us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:25.320720 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:25.320973 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:25.323423 (+ 2450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:25.323431 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:25.324383 (+ 952us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:25.324926 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.324943 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.327029 (+ 2086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.327037 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.328913 (+ 1876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.328931 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.330199 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.330206 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.330416 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.331213 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:25.331236 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:25.332757 (+ 1521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:25.339291 (+ 6534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:25.339296 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:25.339300 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:25.340134 (+ 834us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:25.340649 (+ 515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:25.340654 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:25.340657 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:25.340848 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:25.342152 (+ 1304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:25.342157 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:25.342564 (+ 407us) client_negotiation.cc:769] Sending connection context
0812 00:21:25.343813 (+ 1249us) client_negotiation.cc:240] Negotiation successful
0812 00:21:25.344158 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1169,"mutex_wait_us":5,"thread_start_us":945,"threads_started":1}
I20260812 00:21:25.345960 26901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.321675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44528 (local address 127.18.163.252:40263)
0812 00:21:25.321912 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:25.321920 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:25.328593 (+ 6673us) server_negotiation.cc:407] Connection header received
0812 00:21:25.329115 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:25.329119 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:25.329186 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:25.329301 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:25.330854 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.332082 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.334301 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.335084 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.335185 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.338015 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:25.338024 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:25.338028 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:25.338064 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:25.342553 (+ 4489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.343304 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.343310 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.343314 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.343456 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.343987 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.343992 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.343995 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.344336 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:25.344507 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:25.345125 (+ 618us) server_negotiation.cc:299] Negotiation successful
0812 00:21:25.345536 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":169,"server-negotiator.queue_time_us":71}
I20260812 00:21:25.346165 26925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.321108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40263 (local address 127.0.0.1:44528)
0812 00:21:25.328359 (+ 7251us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:25.328378 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:25.328647 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:25.329319 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:25.329324 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:25.330177 (+ 853us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:25.330697 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.330715 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.332393 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.332399 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.334147 (+ 1748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.334165 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.335517 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.335526 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.335712 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.336365 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:25.336392 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:25.337850 (+ 1458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:25.342716 (+ 4866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:25.342720 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:25.342724 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:25.343170 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:25.343578 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:25.343582 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:25.343586 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:25.343885 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:25.344462 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:25.344467 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:25.344640 (+ 173us) client_negotiation.cc:769] Sending connection context
0812 00:21:25.344782 (+ 142us) client_negotiation.cc:240] Negotiation successful
0812 00:21:25.345391 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7086,"thread_start_us":6846,"threads_started":1}
I20260812 00:21:25.351795 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 26149
Aug 12 00:21:25 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494081, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.254@KRBTEST.COM for oryx/127.18.163.252@KRBTEST.COM
Aug 12 00:21:25 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.163.193@KRBTEST.COM
I20260812 00:21:25.368139 26880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.350613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40263 (local address 127.0.0.1:44538)
0812 00:21:25.350927 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:25.350948 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:25.351077 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:25.351488 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:25.351496 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:25.351983 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:25.352147 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.352157 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.353503 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.353508 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.354692 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.354706 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.355936 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.355944 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.356157 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.356950 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:25.356978 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:25.360091 (+ 3113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:25.364866 (+ 4775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:25.364874 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:25.364879 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:25.365541 (+ 662us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:25.366207 (+ 666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:25.366213 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:25.366217 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:25.366431 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:25.367039 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:25.367044 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:25.367225 (+ 181us) client_negotiation.cc:769] Sending connection context
0812 00:21:25.367383 (+ 158us) client_negotiation.cc:240] Negotiation successful
0812 00:21:25.367728 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181}
I20260812 00:21:25.368229 26901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.350753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44538 (local address 127.18.163.252:40263)
0812 00:21:25.350900 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:25.350904 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:25.351003 (+ 99us) server_negotiation.cc:407] Connection header received
0812 00:21:25.351245 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:25.351252 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:25.351338 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:25.351460 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:25.352315 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.353331 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.354920 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.355718 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.356550 (+ 832us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.360302 (+ 3752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:25.360308 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:25.360311 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:25.360346 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:25.364614 (+ 4268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.365787 (+ 1173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.365793 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.365797 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.366030 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.366572 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.366577 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.366580 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.366901 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:25.367076 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:25.367585 (+ 509us) server_negotiation.cc:299] Negotiation successful
0812 00:21:25.367849 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:21:25.370322 26080 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.18.163.252:40263: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e"
member_type: NON_VOTER
last_known_addr {
host: "127.18.163.252"
port: 40263
}
attrs {
promote: true
}
}
dest_uuid: "16e941ca289a44a9a99608abd9bb8230"
cas_config_opid_index: 5
I20260812 00:21:25.371512 26080 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: NON_VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: true } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: NON_VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: true } }
I20260812 00:21:25.373637 26876 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 847e3ad1da2e49528bcecb9b8e3fd11e (127.18.163.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: NON_VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: true } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: NON_VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: true } } }
I20260812 00:21:25.374485 26864 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:25.378242 26876 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.18.163.252:40263
I20260812 00:21:25.379076 26772 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 1 LEARNER]: Refusing update from remote peer 16e941ca289a44a9a99608abd9bb8230: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 00:21:25.383090 26876 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: NON_VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 00:21:25.383113 26927 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "16e941ca289a44a9a99608abd9bb8230" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: NON_VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: true } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: NON_VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: true } } }
I20260812 00:21:25.383723 26927 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:25.388268 26926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.353405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35840 (local address 127.18.163.193:46795)
0812 00:21:25.354230 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:25.354242 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:25.354276 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:21:25.354347 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:25.354356 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:25.354680 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:25.354860 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:25.356807 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.357977 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.359794 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.360860 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.361059 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.367551 (+ 6492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:25.367573 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:25.367594 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:25.367646 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:25.372194 (+ 4548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.384776 (+ 12582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.384789 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.384793 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.385044 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.385792 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.385799 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.385803 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.386354 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:25.386824 (+ 470us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:25.387361 (+ 537us) server_negotiation.cc:299] Negotiation successful
0812 00:21:25.387782 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":423,"threads_started":1}
I20260812 00:21:25.390347 26289 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:25.398007 26714 master.cc:537] Master@127.18.163.252:40263 shutting down...
I20260812 00:21:25.398097 26864 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 1 FOLLOWER]: Refusing update from remote peer 16e941ca289a44a9a99608abd9bb8230: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 00:21:25.402956 26876 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: NON_VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:25.410537 26772 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 847e3ad1da2e49528bcecb9b8e3fd11e (127.18.163.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: NON_VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: true } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: NON_VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: true } } }
I20260812 00:21:25.417996 26904 raft_consensus.cc:482] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:21:25.418318 26904 raft_consensus.cc:504] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } }
I20260812 00:21:25.419871 26904 leader_election.cc:288] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16e941ca289a44a9a99608abd9bb8230 (127.18.163.254:35307), a10addcd04f8412b83702e3dd63daaf9 (127.18.163.253:39737)
I20260812 00:21:25.421074 26771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10addcd04f8412b83702e3dd63daaf9" is_pre_election: true
I20260812 00:21:25.421099 26091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16e941ca289a44a9a99608abd9bb8230" is_pre_election: true
I20260812 00:21:25.422382 26834 leader_election.cc:302] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847e3ad1da2e49528bcecb9b8e3fd11e; no voters: 16e941ca289a44a9a99608abd9bb8230, a10addcd04f8412b83702e3dd63daaf9
I20260812 00:21:25.422947 26904 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:21:25.424554 26714 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:25.425078 26714 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:25.425318 26714 tablet_replica.cc:330] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: stopping tablet replica
I20260812 00:21:25.426004 26802 sys_catalog.cc:455] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "16e941ca289a44a9a99608abd9bb8230" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: NON_VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: true } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: NON_VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: true } } }
I20260812 00:21:25.426429 26802 sys_catalog.cc:458] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: This master's current role is: LEARNER
I20260812 00:21:25.430953 26927 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230: attempting to promote NON_VOTER a10addcd04f8412b83702e3dd63daaf9 to VOTER
W20260812 00:21:25.431566 26059 consensus_peers.cc:487] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 -> Peer 847e3ad1da2e49528bcecb9b8e3fd11e (127.18.163.252:40263): Couldn't send request to peer 847e3ad1da2e49528bcecb9b8e3fd11e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 00:21:25.432132 26927 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: NON_VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: true } }
I20260812 00:21:25.434885 26772 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 1 LEARNER]: Refusing update from remote peer 16e941ca289a44a9a99608abd9bb8230: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 00:21:25.435581 26876 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 00:21:25.436223 26880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.435706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40263 (local address 127.0.0.1:44542)
0812 00:21:25.435862 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:25.436032 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 00:21:25.436956 26059 consensus_peers.cc:487] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 -> Peer 847e3ad1da2e49528bcecb9b8e3fd11e (127.18.163.252:40263): Couldn't send request to peer 847e3ad1da2e49528bcecb9b8e3fd11e. Status: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40263: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 00:21:25.438818 26714 master.cc:552] Master@127.18.163.252:40263 shutdown complete.
I20260812 00:21:25.438975 26714 master_runner.cc:305] Clearing existing system tablet
I20260812 00:21:25.439462 26714 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:25.439626 26714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:25.439219 26928 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, a10addcd04f8412b83702e3dd63daaf9 (127.18.163.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: NON_VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: true } } }
I20260812 00:21:25.446094 26927 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "16e941ca289a44a9a99608abd9bb8230" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: NON_VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: true } } }
I20260812 00:21:25.446494 26927 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:25.446832 26928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "16e941ca289a44a9a99608abd9bb8230" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: NON_VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: true } } }
I20260812 00:21:25.447243 26928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:25.448580 26772 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, a10addcd04f8412b83702e3dd63daaf9 (127.18.163.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: NON_VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: true } } }
I20260812 00:21:25.454491 26714 fs_manager.cc:709] Time spent opening directory manager: real 0.014s user 0.009s sys 0.004s
I20260812 00:21:25.454526 26802 sys_catalog.cc:455] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "16e941ca289a44a9a99608abd9bb8230" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: NON_VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: true } } }
I20260812 00:21:25.454833 26802 sys_catalog.cc:458] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:21:25.456732 26937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:25.457120 26714 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:25.457484 26714 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 00:21:25.457625 26714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/wal
uuid: "847e3ad1da2e49528bcecb9b8e3fd11e"
format_stamp: "Formatted at 2026-08-12 00:21:25 on dist-test-slave-njxd"
server_key: "68032d1374fdba9431378de96f9db958"
server_key_iv: "fdd912496abcb3195e9ae293a347fdea"
server_key_version: "encryptionkey@0"
I20260812 00:21:25.461251 26714 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:25.466627 26714 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 00:21:25.466832 26714 log.cc:1196] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 00:21:25.467414 26714 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: Deleting consensus metadata
I20260812 00:21:25.467720 26714 master_runner.cc:315] Copying system tablet from 127.18.163.254:35307
I20260812 00:21:25.470474 26714 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: tablet copy: Beginning tablet copy session from remote peer at address 127.18.163.254:35307
I20260812 00:21:25.489764 26684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.471380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57412 (local address 127.18.163.254:35307)
0812 00:21:25.471663 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:25.471674 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:25.474196 (+ 2522us) server_negotiation.cc:407] Connection header received
0812 00:21:25.474531 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:25.474559 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:25.474668 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:25.474760 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:25.476137 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.477245 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.479266 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.479907 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.480007 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.482626 (+ 2619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:25.482633 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:25.482638 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:25.482681 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:25.486374 (+ 3693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.487311 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.487317 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.487322 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.487496 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:25.487964 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:25.487969 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:25.487972 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:25.488337 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:25.488485 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:25.489059 (+ 574us) server_negotiation.cc:299] Negotiation successful
0812 00:21:25.489323 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260812 00:21:25.490885 26945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.471454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.0.0.1:57412)
0812 00:21:25.474031 (+ 2577us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:25.474052 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:25.474342 (+ 290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:25.475007 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:25.475012 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:25.475649 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:25.475954 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.475968 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.477461 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.477466 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.479082 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.479099 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.480297 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.480302 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.480469 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.481242 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:25.481271 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:25.482385 (+ 1114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:25.486593 (+ 4208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:25.486599 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:25.486604 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:25.487147 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:25.487646 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:25.487651 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:25.487654 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:25.487838 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:25.488569 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:25.488574 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:25.488759 (+ 185us) client_negotiation.cc:769] Sending connection context
0812 00:21:25.490073 (+ 1314us) client_negotiation.cc:240] Negotiation successful
0812 00:21:25.490455 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2438,"thread_start_us":2295,"threads_started":1}
I20260812 00:21:25.491528 26104 tablet_copy_service.cc:140] P 16e941ca289a44a9a99608abd9bb8230: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 847e3ad1da2e49528bcecb9b8e3fd11e ({username='oryx', principal='oryx/127.18.163.252@KRBTEST.COM'} at 127.0.0.1:57412)
I20260812 00:21:25.491730 26104 tablet_copy_service.cc:161] P 16e941ca289a44a9a99608abd9bb8230: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 847e3ad1da2e49528bcecb9b8e3fd11e at {username='oryx', principal='oryx/127.18.163.252@KRBTEST.COM'} at 127.0.0.1:57412: session id = 847e3ad1da2e49528bcecb9b8e3fd11e-00000000000000000000000000000000
I20260812 00:21:25.495582 26104 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 00:21:25.497684 26714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 00:21:25.505023 26714 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: tablet copy: Starting download of 0 data blocks...
I20260812 00:21:25.505395 26714 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: tablet copy: Starting download of 1 WAL segments...
I20260812 00:21:25.508318 26714 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 00:21:25.513219 26104 tablet_copy_service.cc:342] P 16e941ca289a44a9a99608abd9bb8230: Request end of tablet copy session 847e3ad1da2e49528bcecb9b8e3fd11e-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.18.163.252@KRBTEST.COM'} at 127.0.0.1:57412
I20260812 00:21:25.513398 26104 tablet_copy_service.cc:433] P 16e941ca289a44a9a99608abd9bb8230: ending tablet copy session 847e3ad1da2e49528bcecb9b8e3fd11e-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 847e3ad1da2e49528bcecb9b8e3fd11e
I20260812 00:21:25.525810 26714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:25.528780 26946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:25.531034 26947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:25.547436 26714 server_base.cc:1034] running on GCE node
W20260812 00:21:25.550431 26949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:25.551648 26714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:25.552474 26714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:25.553678 26714 hybrid_clock.cc:648] HybridClock initialized: now 1786494085553627 us; error 55 us; skew 500 ppm
I20260812 00:21:25.554014 26714 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:25 dist-test-slave-njxd krb5kdc[26025](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494085, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:25.556795 26714 init.cc:377] Logged in from keytab as oryx/127.18.163.252@KRBTEST.COM (short username oryx)
I20260812 00:21:25.558271 26714 webserver.cc:460] Webserver started at http://127.18.163.252:36477/ using document root <none> and password file <none>
I20260812 00:21:25.558578 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 26149
I20260812 00:21:25.558645 26714 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:25.559238 26714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:25.563757 26714 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:21:25.566246 26956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:25.566995 26714 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 00:21:25.567150 26714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/wal
uuid: "847e3ad1da2e49528bcecb9b8e3fd11e"
format_stamp: "Formatted at 2026-08-12 00:21:25 on dist-test-slave-njxd"
server_key: "68032d1374fdba9431378de96f9db958"
server_key_iv: "fdd912496abcb3195e9ae293a347fdea"
server_key_version: "encryptionkey@0"
I20260812 00:21:25.567363 26714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:25.589826 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:46795
--local_ip_for_outbound_sockets=127.18.163.193
--tserver_master_addrs=127.18.163.254:35307
--webserver_port=38847
--webserver_interface=127.18.163.193
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.193.keytab
--principal=oryx/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.18.163.254:35307,127.18.163.253:39737
--tserver_master_addrs=127.18.163.254:35307,127.18.163.253:39737,127.18.163.252:40263 with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:21:25.594873 26714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:25.598618 26714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:25.629951 26714 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.252:40263
I20260812 00:21:25.629973 27011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.252:40263 every 8 connection(s)
I20260812 00:21:25.631003 26714 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/master-2/data/info.pb
I20260812 00:21:25.638495 27012 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:21:25.644376 27012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: Bootstrap starting.
I20260812 00:21:25.662773 27012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:21:25.663369 27012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: Bootstrap complete.
I20260812 00:21:25.664515 27012 raft_consensus.cc:348] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: NON_VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: true } }
I20260812 00:21:25.664836 27012 raft_consensus.cc:729] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 847e3ad1da2e49528bcecb9b8e3fd11e, State: Initialized, Role: LEARNER
I20260812 00:21:25.665091 27012 consensus_queue.cc:260] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: NON_VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: true } }
I20260812 00:21:25.666131 27015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: NON_VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: true } } }
I20260812 00:21:25.666494 27012 sys_catalog.cc:564] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:21:25.666642 27015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [sys.catalog]: This master's current role is: LEARNER
I20260812 00:21:25.676512 27028 catalog_manager.cc:1259] Loaded cluster ID: 948a8bfb8dc64a31b2e6944f04b6502d
I20260812 00:21:25.676782 27028 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: loading cluster ID for follower catalog manager: success
I20260812 00:21:25.679919 27028 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: acquiring CA information for follower catalog manager: success
I20260812 00:21:25.682016 27028 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:21:25.987646 27030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.980310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40263 (local address 127.0.0.1:44546)
0812 00:21:25.980847 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:25.980874 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:25.981043 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:25.981611 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:25.981616 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:25.981648 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:25.981829 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.981838 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.983784 (+ 1946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.983788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.984980 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:25.984994 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.986799 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.986806 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:25.987004 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.987057 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 00:21:25.987176 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 00:21:25.987361 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":239,"threads_started":1}
I20260812 00:21:25.987780 27031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:25.980514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44546 (local address 127.18.163.252:40263)
0812 00:21:25.981164 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:25.981172 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:25.981211 (+ 39us) server_negotiation.cc:407] Connection header received
0812 00:21:25.981292 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:25.981298 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:25.981394 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:25.981537 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:25.981996 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.983626 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.985165 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:25.986571 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:25.986851 (+ 280us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:25.987094 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:25.987228 (+ 134us) server_negotiation.cc:299] Negotiation successful
0812 00:21:25.987385 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":345,"threads_started":1}
I20260812 00:21:25.988783 26984 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260812 00:21:25.989466 27015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16e941ca289a44a9a99608abd9bb8230. Latest consensus state: current_term: 1 leader_uuid: "16e941ca289a44a9a99608abd9bb8230" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: NON_VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: true } } }
I20260812 00:21:25.989847 27015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [sys.catalog]: This master's current role is: LEARNER
W20260812 00:21:26.053879 26963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:26.054278 26963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:26.054466 26963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:26.062868 26963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:26.063068 26963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:26.063263 26963 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:21:26.074882 26963 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.193.keytab
--principal=oryx/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:46795
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=38847
--tserver_master_addrs=127.18.163.254:35307,127.18.163.253:39737,127.18.163.252:40263
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:26.076371 26963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:26.077904 26963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:26.093398 27038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:26.093297 27039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:26.093376 27042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:26.094390 26963 server_base.cc:1034] running on GCE node
I20260812 00:21:26.095057 26963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:26.096134 26963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:26.097344 26963 hybrid_clock.cc:648] HybridClock initialized: now 1786494086097290 us; error 45 us; skew 500 ppm
I20260812 00:21:26.097723 26963 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:26 dist-test-slave-njxd krb5kdc[26025](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494086, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:26.101181 26963 init.cc:377] Logged in from keytab as oryx/127.18.163.193@KRBTEST.COM (short username oryx)
I20260812 00:21:26.102881 26963 webserver.cc:460] Webserver started at http://127.18.163.193:38847/ using document root <none> and password file <none>
I20260812 00:21:26.103595 26963 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:26.103725 26963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:26.109539 26963 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 00:21:26.112619 27052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:26.114271 26963 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:21:26.114461 26963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "2032db1dcec4456783180ee086ed6940"
format_stamp: "Formatted at 2026-08-12 00:21:22 on dist-test-slave-njxd"
server_key: "5aeed8a825919957df0dd24b67f89ecd"
server_key_iv: "24a0c7e7a750ba75496f08b903b6d28f"
server_key_version: "encryptionkey@0"
I20260812 00:21:26.115710 26963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:26.146588 26963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:26.151399 26963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:26.151736 26963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:26.152860 26963 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:26.154565 26963 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:26.154716 26963 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:26.154847 26963 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:26.154944 26963 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:26.195429 26963 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:46795
I20260812 00:21:26.195528 27176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:46795 every 8 connection(s)
I20260812 00:21:26.197067 26963 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:21:26.198242 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 26963
I20260812 00:21:26.198622 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 26301
Aug 12 00:21:26 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.163.194@KRBTEST.COM
I20260812 00:21:26.228631 27181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:26.200152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42980 (local address 127.18.163.194:43693)
0812 00:21:26.200937 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:26.200950 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:26.201568 (+ 618us) server_negotiation.cc:407] Connection header received
0812 00:21:26.201848 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:26.201862 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:26.202168 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:26.205075 (+ 2907us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:26.205428 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.207616 (+ 2188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.210487 (+ 2871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.211599 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.211754 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:26.219235 (+ 7481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:26.219259 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:26.219277 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:26.219336 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:26.224244 (+ 4908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:26.225261 (+ 1017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:26.225269 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:26.225271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:26.225467 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:26.225988 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:26.225995 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:26.226001 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:26.226504 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:26.227626 (+ 1122us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:26.227834 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 00:21:26.228162 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":376,"threads_started":1}
I20260812 00:21:26.230589 26437 generic_service.cc:196] Checking for leaks (request via RPC)
Aug 12 00:21:26 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494086, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.252@KRBTEST.COM
Aug 12 00:21:26 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494086, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.253@KRBTEST.COM
Aug 12 00:21:26 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494086, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM
I20260812 00:21:26.243314 27183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:26.200471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:49967 (local address 127.18.163.254:35307)
0812 00:21:26.218785 (+ 18314us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:26.218793 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:26.218815 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:21:26.218889 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:26.218896 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:26.218999 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:26.219154 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:26.222383 (+ 3229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.223660 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.228963 (+ 5303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.229685 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.229823 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:26.235271 (+ 5448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:26.235280 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:26.235285 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:26.235343 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:26.239526 (+ 4183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:26.240491 (+ 965us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:26.240498 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:26.240502 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:26.240674 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:26.241172 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:26.241188 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:26.241192 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:26.241630 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:26.241788 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:26.242610 (+ 822us) server_negotiation.cc:299] Negotiation successful
0812 00:21:26.242871 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18166,"thread_start_us":18856,"threads_started":1}
I20260812 00:21:26.244096 27031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:26.202256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:55711 (local address 127.18.163.252:40263)
0812 00:21:26.202509 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:26.202518 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:26.211768 (+ 9250us) server_negotiation.cc:407] Connection header received
0812 00:21:26.218094 (+ 6326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:26.218101 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:26.218203 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:26.218290 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:26.222454 (+ 4164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.223611 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.227323 (+ 3712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.228013 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.228203 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:26.233938 (+ 5735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:26.233949 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:26.233955 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:26.234008 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:26.238635 (+ 4627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:26.240302 (+ 1667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:26.240313 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:26.240319 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:26.240554 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:26.241299 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:26.241307 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:26.241313 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:26.241864 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:26.242062 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:26.243166 (+ 1104us) server_negotiation.cc:299] Negotiation successful
0812 00:21:26.243549 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260812 00:21:26.244608 27185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:26.202508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.193:49967)
0812 00:21:26.215957 (+ 13449us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:26.215996 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:26.217614 (+ 1618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:26.219618 (+ 2004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:26.219624 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:26.220853 (+ 1229us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:26.221703 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:26.221733 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.223825 (+ 2092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.223830 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:26.226489 (+ 2659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:26.226514 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.230132 (+ 3618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.230143 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:26.230343 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:26.231080 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:26.231114 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:26.234649 (+ 3535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:26.239691 (+ 5042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:26.239697 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:26.239701 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:26.240341 (+ 640us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:26.240796 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:26.240802 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:26.240806 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:26.241028 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:26.241742 (+ 714us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:26.241751 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:26.242175 (+ 424us) client_negotiation.cc:769] Sending connection context
0812 00:21:26.242503 (+ 328us) client_negotiation.cc:240] Negotiation successful
0812 00:21:26.243133 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13248,"mutex_wait_us":127,"thread_start_us":13616,"threads_started":1}
I20260812 00:21:26.246604 27184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:26.201373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40263 (local address 127.18.163.193:55711)
0812 00:21:26.211560 (+ 10187us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:26.211647 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:26.217403 (+ 5756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:26.218956 (+ 1553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:26.218973 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:26.221917 (+ 2944us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:26.222245 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:26.222256 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.223830 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.223834 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:26.227006 (+ 3172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:26.227017 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.228319 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.228329 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:26.228665 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:26.229661 (+ 996us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:26.229698 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:26.233535 (+ 3837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:26.239019 (+ 5484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:26.239047 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:26.239079 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:26.240078 (+ 999us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:26.240752 (+ 674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:26.240760 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:26.240766 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:26.241119 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:26.242172 (+ 1053us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:26.242180 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:26.242447 (+ 267us) client_negotiation.cc:769] Sending connection context
0812 00:21:26.242619 (+ 172us) client_negotiation.cc:240] Negotiation successful
0812 00:21:26.246145 (+ 3526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9764,"mutex_wait_us":3116,"thread_start_us":9437,"threads_started":1}
I20260812 00:21:26.246657 27178 heartbeater.cc:347] Connected to a master server at 127.18.163.254:35307
I20260812 00:21:26.247045 27178 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:26.247845 27177 heartbeater.cc:347] Connected to a master server at 127.18.163.252:40263
I20260812 00:21:26.248021 27177 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:26.248162 27178 heartbeater.cc:511] Master 127.18.163.254:35307 requested a full tablet report, sending...
I20260812 00:21:26.248564 27177 heartbeater.cc:511] Master 127.18.163.252:40263 requested a full tablet report, sending...
I20260812 00:21:26.250131 27188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:26.218775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39737 (local address 127.18.163.193:42077)
0812 00:21:26.220723 (+ 1948us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:26.220745 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:26.220869 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:26.222964 (+ 2095us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:26.222969 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:26.223493 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:26.224140 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:26.224154 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.225865 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.225873 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:26.227531 (+ 1658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:26.227548 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.228621 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.228627 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:26.228814 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:26.229765 (+ 951us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:26.229797 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:26.235512 (+ 5715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:26.245146 (+ 9634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:26.245163 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:26.245170 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:26.245814 (+ 644us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:26.247135 (+ 1321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:26.247140 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:26.247146 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:26.247404 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:26.248257 (+ 853us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:26.248265 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:26.249172 (+ 907us) client_negotiation.cc:769] Sending connection context
0812 00:21:26.249339 (+ 167us) client_negotiation.cc:240] Negotiation successful
0812 00:21:26.249708 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1811,"mutex_wait_us":3,"spinlock_wait_cycles":24320,"thread_start_us":1617,"threads_started":1}
I20260812 00:21:26.250335 27187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:26.212684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:42077 (local address 127.18.163.253:39737)
0812 00:21:26.222393 (+ 9709us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:26.222402 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:26.222432 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:21:26.222497 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:26.222506 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:26.222622 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:26.222731 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:26.224393 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.225693 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.227742 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.228233 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.228367 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:26.235842 (+ 7475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:26.235853 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:26.235858 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:26.235906 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:26.241455 (+ 5549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:26.245972 (+ 4517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:26.245979 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:26.245982 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:26.246974 (+ 992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:26.247582 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:26.247587 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:26.247589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:26.248005 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:26.248167 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:26.249617 (+ 1450us) server_negotiation.cc:299] Negotiation successful
0812 00:21:26.249922 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9564,"thread_start_us":9448,"threads_started":1}
I20260812 00:21:26.250874 26974 ts_manager.cc:194] Registered new tserver with Master: 2032db1dcec4456783180ee086ed6940 (127.18.163.193:46795)
I20260812 00:21:26.252249 27179 heartbeater.cc:347] Connected to a master server at 127.18.163.253:39737
I20260812 00:21:26.252403 27179 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:26.252936 27179 heartbeater.cc:511] Master 127.18.163.253:39737 requested a full tablet report, sending...
I20260812 00:21:26.253206 26080 ts_manager.cc:194] Re-registered known tserver with Master: 2032db1dcec4456783180ee086ed6940 (127.18.163.193:46795)
I20260812 00:21:26.254417 26080 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:49967
I20260812 00:21:26.255036 26759 ts_manager.cc:194] Registered new tserver with Master: 2032db1dcec4456783180ee086ed6940 (127.18.163.193:46795)
I20260812 00:21:26.336004 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 26301
I20260812 00:21:26.358446 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:43693
--local_ip_for_outbound_sockets=127.18.163.194
--tserver_master_addrs=127.18.163.254:35307
--webserver_port=34297
--webserver_interface=127.18.163.194
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.194.keytab
--principal=oryx/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.18.163.254:35307,127.18.163.253:39737
--tserver_master_addrs=127.18.163.254:35307,127.18.163.253:39737,127.18.163.252:40263 with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:21:26.387151 27029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "16e941ca289a44a9a99608abd9bb8230" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: NON_VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: true } } }
I20260812 00:21:26.387679 27029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:26.389725 27192 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230: attempting to promote NON_VOTER 847e3ad1da2e49528bcecb9b8e3fd11e to VOTER
I20260812 00:21:26.390357 27192 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false } }
I20260812 00:21:26.392403 26772 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 1 FOLLOWER]: Refusing update from remote peer 16e941ca289a44a9a99608abd9bb8230: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260812 00:21:26.392417 26984 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 1 LEARNER]: Refusing update from remote peer 16e941ca289a44a9a99608abd9bb8230: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260812 00:21:26.392979 27192 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 00:21:26.393414 27029 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 00:21:26.396389 27029 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 847e3ad1da2e49528bcecb9b8e3fd11e (127.18.163.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false } } }
I20260812 00:21:26.396922 26772 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 847e3ad1da2e49528bcecb9b8e3fd11e (127.18.163.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false } } }
I20260812 00:21:26.400436 27029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "16e941ca289a44a9a99608abd9bb8230" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false } } }
I20260812 00:21:26.400705 27029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:26.400738 27192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "16e941ca289a44a9a99608abd9bb8230" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false } } }
I20260812 00:21:26.401057 27192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:26.402555 27029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "16e941ca289a44a9a99608abd9bb8230" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false } } }
I20260812 00:21:26.402909 27029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:26.402853 26984 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 847e3ad1da2e49528bcecb9b8e3fd11e (127.18.163.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false } } }
I20260812 00:21:26.407585 27015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "16e941ca289a44a9a99608abd9bb8230" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false } } }
I20260812 00:21:26.407879 27015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:21:26.407959 27196 sys_catalog.cc:455] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "16e941ca289a44a9a99608abd9bb8230" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false } } }
I20260812 00:21:26.408440 27196 sys_catalog.cc:458] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 00:21:26.739494 27190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:26.739833 27190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:26.740036 27190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:26.748056 27190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:26.748186 27190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:26.748370 27190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:21:26.759017 27190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.194.keytab
--principal=oryx/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:43693
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=34297
--tserver_master_addrs=127.18.163.254:35307,127.18.163.253:39737,127.18.163.252:40263
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:26.760545 27190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:26.762133 27190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:26.777061 27205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:26.777292 27202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:26.777369 27203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:26.779256 27190 server_base.cc:1034] running on GCE node
I20260812 00:21:26.780018 27190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:26.781198 27190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:26.782457 27190 hybrid_clock.cc:648] HybridClock initialized: now 1786494086782414 us; error 49 us; skew 500 ppm
I20260812 00:21:26.782837 27190 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:26 dist-test-slave-njxd krb5kdc[26025](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494086, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:26.786422 27190 init.cc:377] Logged in from keytab as oryx/127.18.163.194@KRBTEST.COM (short username oryx)
I20260812 00:21:26.788218 27190 webserver.cc:460] Webserver started at http://127.18.163.194:34297/ using document root <none> and password file <none>
I20260812 00:21:26.789058 27190 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:26.789230 27190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:26.795560 27190 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 00:21:26.798993 27212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:26.800520 27190 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:21:26.800737 27190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "cf032d1d952d46ceb0695d05b37e8ca1"
format_stamp: "Formatted at 2026-08-12 00:21:23 on dist-test-slave-njxd"
server_key: "c52278536c60f83650093a28213195fd"
server_key_iv: "ebfbb0a5b59083e0cfcc474d4938cc52"
server_key_version: "encryptionkey@0"
I20260812 00:21:26.801972 27190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:26.830322 27190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:26.835820 27190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:26.836113 27190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:26.837212 27190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:26.838877 27190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:26.838986 27190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:26.839077 27190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:26.839133 27190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:26.875639 27190 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:43693
I20260812 00:21:26.875699 27340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:43693 every 8 connection(s)
I20260812 00:21:26.877274 27190 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:21:26.880774 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 27190
I20260812 00:21:26.881126 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 26448
Aug 12 00:21:26 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.163.195@KRBTEST.COM
Aug 12 00:21:26 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494086, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM
Aug 12 00:21:26 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494086, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.252@KRBTEST.COM
Aug 12 00:21:26 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494086, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.253@KRBTEST.COM
I20260812 00:21:26.923173 27349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:26.882174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60338 (local address 127.18.163.195:46691)
0812 00:21:26.894690 (+ 12516us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:26.894701 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:26.895674 (+ 973us) server_negotiation.cc:407] Connection header received
0812 00:21:26.895775 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:26.895784 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:26.896076 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:26.896253 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:26.898889 (+ 2636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.900554 (+ 1665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.903456 (+ 2902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.904256 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.904350 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:26.911851 (+ 7501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:26.911878 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:26.911905 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:26.911971 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:26.917714 (+ 5743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:26.918734 (+ 1020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:26.918744 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:26.918748 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:26.918931 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:26.919423 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:26.919429 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:26.919432 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:26.921453 (+ 2021us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:26.921879 (+ 426us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:26.922281 (+ 402us) server_negotiation.cc:299] Negotiation successful
0812 00:21:26.922620 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12257,"thread_start_us":12547,"threads_started":1}
I20260812 00:21:26.924798 26590 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:26.931056 27345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:26.880480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:59335 (local address 127.18.163.254:35307)
0812 00:21:26.880980 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:26.880987 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:26.895054 (+ 14067us) server_negotiation.cc:407] Connection header received
0812 00:21:26.901187 (+ 6133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:26.901197 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:26.901321 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:26.901431 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:26.905035 (+ 3604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.906289 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.910822 (+ 4533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.911523 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.911652 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:26.918968 (+ 7316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:26.918978 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:26.918985 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:26.919036 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:26.924460 (+ 5424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:26.927343 (+ 2883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:26.927350 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:26.927354 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:26.927549 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:26.928169 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:26.928177 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:26.928184 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:26.928629 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:26.928778 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:26.930363 (+ 1585us) server_negotiation.cc:299] Negotiation successful
0812 00:21:26.930668 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":270,"threads_started":1}
I20260812 00:21:26.931363 27346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:26.880440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:58619 (local address 127.18.163.252:40263)
0812 00:21:26.881323 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:26.881328 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:26.895766 (+ 14438us) server_negotiation.cc:407] Connection header received
0812 00:21:26.907195 (+ 11429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:26.907204 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:26.907312 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:26.907444 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:26.908807 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.910012 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.912608 (+ 2596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.913352 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.913499 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:26.920623 (+ 7124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:26.920630 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:26.920635 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:26.920685 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:26.926405 (+ 5720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:26.927767 (+ 1362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:26.927774 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:26.927777 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:26.927947 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:26.928516 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:26.928521 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:26.928525 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:26.928908 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:26.929739 (+ 831us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:26.930710 (+ 971us) server_negotiation.cc:299] Negotiation successful
0812 00:21:26.930958 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":763,"thread_start_us":640,"threads_started":1}
I20260812 00:21:26.932430 27351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:26.883202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.194:59335)
0812 00:21:26.894814 (+ 11612us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:26.894883 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:26.900744 (+ 5861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:26.902282 (+ 1538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:26.902301 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:26.903580 (+ 1279us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:26.904732 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:26.904767 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.907208 (+ 2441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.907216 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:26.910629 (+ 3413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:26.910652 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.914278 (+ 3626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.914285 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:26.914444 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:26.915202 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:26.915238 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:26.918712 (+ 3474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:26.925631 (+ 6919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:26.925641 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:26.925663 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:26.926588 (+ 925us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:26.927674 (+ 1086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:26.927679 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:26.927682 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:26.927973 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:26.929844 (+ 1871us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:26.929850 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:26.930024 (+ 174us) client_negotiation.cc:769] Sending connection context
0812 00:21:26.930199 (+ 175us) client_negotiation.cc:240] Negotiation successful
0812 00:21:26.930786 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11205,"mutex_wait_us":57,"thread_start_us":10857,"threads_started":1}
I20260812 00:21:26.932547 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:26.883202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40263 (local address 127.18.163.194:58619)
0812 00:21:26.895653 (+ 12451us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:26.895672 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:26.899865 (+ 4193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:26.907683 (+ 7818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:26.907690 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:26.908251 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:26.908584 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:26.908599 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.910258 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.910263 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:26.912436 (+ 2173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:26.912450 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.913886 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.913896 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:26.914296 (+ 400us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:26.915216 (+ 920us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:26.915260 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:26.920305 (+ 5045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:26.926650 (+ 6345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:26.926658 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:26.926661 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:26.927147 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:26.928103 (+ 956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:26.928109 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:26.928112 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:26.928303 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:26.929081 (+ 778us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:26.929093 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:26.929683 (+ 590us) client_negotiation.cc:769] Sending connection context
0812 00:21:26.930087 (+ 404us) client_negotiation.cc:240] Negotiation successful
0812 00:21:26.931733 (+ 1646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12279,"mutex_wait_us":1051,"spinlock_wait_cycles":62976,"thread_start_us":12366,"threads_started":1}
I20260812 00:21:26.934204 27341 heartbeater.cc:347] Connected to a master server at 127.18.163.252:40263
I20260812 00:21:26.934593 27341 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:26.935649 27341 heartbeater.cc:511] Master 127.18.163.252:40263 requested a full tablet report, sending...
I20260812 00:21:26.936676 27342 heartbeater.cc:347] Connected to a master server at 127.18.163.254:35307
I20260812 00:21:26.936829 27342 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:26.937342 27342 heartbeater.cc:511] Master 127.18.163.254:35307 requested a full tablet report, sending...
I20260812 00:21:26.938365 27353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:26.896262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39737 (local address 127.18.163.194:47847)
0812 00:21:26.906479 (+ 10217us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:26.906505 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:26.906686 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:26.912863 (+ 6177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:26.912869 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:26.913529 (+ 660us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:26.914038 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:26.914057 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.916995 (+ 2938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.917001 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:26.918378 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:26.918395 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.919640 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.919647 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:26.919860 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:26.920466 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:26.920564 (+ 98us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:26.925275 (+ 4711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:26.935028 (+ 9753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:26.935035 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:26.935039 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:26.935635 (+ 596us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:26.936174 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:26.936179 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:26.936183 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:26.936371 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:26.937179 (+ 808us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:26.937183 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:26.937390 (+ 207us) client_negotiation.cc:769] Sending connection context
0812 00:21:26.937527 (+ 137us) client_negotiation.cc:240] Negotiation successful
0812 00:21:26.937909 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10044,"thread_start_us":10526,"threads_started":1}
I20260812 00:21:26.938704 26974 ts_manager.cc:194] Registered new tserver with Master: cf032d1d952d46ceb0695d05b37e8ca1 (127.18.163.194:43693)
I20260812 00:21:26.938905 26080 ts_manager.cc:194] Re-registered known tserver with Master: cf032d1d952d46ceb0695d05b37e8ca1 (127.18.163.194:43693)
I20260812 00:21:26.939524 27354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:26.896361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:47847 (local address 127.18.163.253:39737)
0812 00:21:26.912500 (+ 16139us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:26.912508 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:26.912534 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:21:26.912612 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:26.912618 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:26.912708 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:26.912826 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:26.915661 (+ 2835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.916776 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.918627 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:26.919271 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:26.919644 (+ 373us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:26.928956 (+ 9312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:26.928967 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:26.928973 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:26.929027 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:26.934846 (+ 5819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:26.935845 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:26.935852 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:26.935858 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:26.936021 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:26.936521 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:26.936526 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:26.936529 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:26.937014 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:26.938762 (+ 1748us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:26.938910 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 00:21:26.939170 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15988,"thread_start_us":16568,"threads_started":1}
I20260812 00:21:26.940088 26080 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:59335
I20260812 00:21:26.940512 27343 heartbeater.cc:347] Connected to a master server at 127.18.163.253:39737
I20260812 00:21:26.940714 27343 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:26.941282 27343 heartbeater.cc:511] Master 127.18.163.253:39737 requested a full tablet report, sending...
I20260812 00:21:26.942636 26759 ts_manager.cc:194] Registered new tserver with Master: cf032d1d952d46ceb0695d05b37e8ca1 (127.18.163.194:43693)
I20260812 00:21:27.018873 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 26448
I20260812 00:21:27.042236 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:46691
--local_ip_for_outbound_sockets=127.18.163.195
--tserver_master_addrs=127.18.163.254:35307
--webserver_port=43637
--webserver_interface=127.18.163.195
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.195.keytab
--principal=oryx/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.18.163.254:35307,127.18.163.253:39737
--tserver_master_addrs=127.18.163.254:35307,127.18.163.253:39737,127.18.163.252:40263 with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:21:27.257145 27178 heartbeater.cc:503] Master 127.18.163.254:35307 was elected leader, sending a full tablet report...
W20260812 00:21:27.423880 27357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:27.424234 27357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:27.424381 27357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:27.432379 27357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:27.432538 27357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:27.432770 27357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:21:27.443717 27357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.195.keytab
--principal=oryx/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:46691
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=43637
--tserver_master_addrs=127.18.163.254:35307,127.18.163.253:39737,127.18.163.252:40263
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:27.445122 27357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:27.446614 27357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:27.461010 27365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:27.461068 27363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:27.461090 27362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:27.462246 27357 server_base.cc:1034] running on GCE node
I20260812 00:21:27.462970 27357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:27.464047 27357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:27.465292 27357 hybrid_clock.cc:648] HybridClock initialized: now 1786494087465232 us; error 56 us; skew 500 ppm
I20260812 00:21:27.465754 27357 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:27 dist-test-slave-njxd krb5kdc[26025](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494087, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:27.469519 27357 init.cc:377] Logged in from keytab as oryx/127.18.163.195@KRBTEST.COM (short username oryx)
I20260812 00:21:27.471406 27357 webserver.cc:460] Webserver started at http://127.18.163.195:43637/ using document root <none> and password file <none>
I20260812 00:21:27.472303 27357 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:27.472481 27357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:27.478919 27357 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 00:21:27.482105 27374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:27.483723 27357 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260812 00:21:27.483951 27357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "bbed97135e09454083b90c16e90b7475"
format_stamp: "Formatted at 2026-08-12 00:21:23 on dist-test-slave-njxd"
server_key: "b15cadf35afee6c0a153a4a13a0b4e40"
server_key_iv: "e3ab7801014bd0731c4f60e5132574b7"
server_key_version: "encryptionkey@0"
I20260812 00:21:27.485081 27357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:27.529474 27357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:27.533911 27357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:27.534235 27357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:27.535354 27357 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:27.536891 27357 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:27.537027 27357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:27.537158 27357 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:27.537258 27357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:27.574986 27357 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:46691
I20260812 00:21:27.575040 27498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:46691 every 8 connection(s)
I20260812 00:21:27.576656 27357 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:21:27.583846 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 27357
Aug 12 00:21:27 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494087, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.253@KRBTEST.COM
Aug 12 00:21:27 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494087, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.252@KRBTEST.COM
Aug 12 00:21:27 dist-test-slave-njxd krb5kdc[26025](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494087, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM
I20260812 00:21:27.623270 27506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.580817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39737 (local address 127.18.163.195:46547)
0812 00:21:27.582161 (+ 1344us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:27.582224 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:27.592538 (+ 10314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:27.593289 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:27.593307 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:27.594781 (+ 1474us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:27.595949 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.595980 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.597142 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.597151 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.599466 (+ 2315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.599482 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.600647 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.600658 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.601068 (+ 410us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.602171 (+ 1103us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:27.602219 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:27.606575 (+ 4356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:27.616968 (+ 10393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:27.616982 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:27.617007 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:27.617924 (+ 917us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:27.618533 (+ 609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:27.618553 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:27.618559 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:27.618910 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:27.619783 (+ 873us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:27.619792 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:27.620439 (+ 647us) client_negotiation.cc:769] Sending connection context
0812 00:21:27.620835 (+ 396us) client_negotiation.cc:240] Negotiation successful
0812 00:21:27.621483 (+ 648us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":869,"mutex_wait_us":1,"thread_start_us":930,"threads_started":1}
I20260812 00:21:27.625243 27503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.579970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:46547 (local address 127.18.163.253:39737)
0812 00:21:27.580588 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:27.580599 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:27.582390 (+ 1791us) server_negotiation.cc:407] Connection header received
0812 00:21:27.592705 (+ 10315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:27.592709 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:27.592788 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:27.592916 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:27.596183 (+ 3267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.596961 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.599624 (+ 2663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.600391 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.600550 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.606985 (+ 6435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:27.606996 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:27.607004 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:27.607120 (+ 116us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:27.616750 (+ 9630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:27.618136 (+ 1386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:27.618144 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:27.618148 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:27.618346 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:27.619101 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:27.619106 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:27.619110 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:27.619595 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:27.624317 (+ 4722us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:27.624489 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 00:21:27.624775 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":404,"threads_started":1}
I20260812 00:21:27.626561 27508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.583458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:55057 (local address 127.18.163.252:40263)
0812 00:21:27.594079 (+ 10621us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:27.594089 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:27.594975 (+ 886us) server_negotiation.cc:407] Connection header received
0812 00:21:27.595054 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:27.595061 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:27.595158 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:27.595353 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:27.597083 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.598229 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.606480 (+ 8251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.607726 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.607883 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.616116 (+ 8233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:27.616127 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:27.616133 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:27.616185 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:27.621349 (+ 5164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:27.622357 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:27.622366 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:27.622370 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:27.622533 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:27.623011 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:27.623016 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:27.623019 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:27.623456 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:27.623639 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:27.625111 (+ 1472us) server_negotiation.cc:299] Negotiation successful
0812 00:21:27.626183 (+ 1072us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10456,"thread_start_us":10337,"threads_started":1}
I20260812 00:21:27.626700 27501 heartbeater.cc:347] Connected to a master server at 127.18.163.253:39737
I20260812 00:21:27.627141 27501 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:27.628301 27501 heartbeater.cc:511] Master 127.18.163.253:39737 requested a full tablet report, sending...
I20260812 00:21:27.630584 26759 ts_manager.cc:194] Registered new tserver with Master: bbed97135e09454083b90c16e90b7475 (127.18.163.195:46691)
I20260812 00:21:27.624832 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.587968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40263 (local address 127.18.163.195:55057)
0812 00:21:27.594686 (+ 6718us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:27.594711 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:27.594874 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:27.595375 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:27.595379 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:27.596213 (+ 834us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:27.596882 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.596895 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.598418 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.598424 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.600024 (+ 1600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.600040 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.607954 (+ 7914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.607963 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.608646 (+ 683us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.611117 (+ 2471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:27.611156 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:27.615819 (+ 4663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:27.621530 (+ 5711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:27.621535 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:27.621538 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:27.622180 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:27.622683 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:27.622687 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:27.622690 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:27.622863 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:27.623710 (+ 847us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:27.623716 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:27.623907 (+ 191us) client_negotiation.cc:769] Sending connection context
0812 00:21:27.624075 (+ 168us) client_negotiation.cc:240] Negotiation successful
0812 00:21:27.624404 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6547,"mutex_wait_us":104,"spinlock_wait_cycles":2304,"thread_start_us":977,"threads_started":1}
I20260812 00:21:27.632761 27499 heartbeater.cc:347] Connected to a master server at 127.18.163.252:40263
I20260812 00:21:27.632921 27499 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:27.633388 27499 heartbeater.cc:511] Master 127.18.163.252:40263 requested a full tablet report, sending...
I20260812 00:21:27.634841 26974 ts_manager.cc:194] Registered new tserver with Master: bbed97135e09454083b90c16e90b7475 (127.18.163.195:46691)
I20260812 00:21:27.640334 27512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.581638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.195:52569)
0812 00:21:27.588753 (+ 7115us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:27.588782 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:27.592000 (+ 3218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:27.595572 (+ 3572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:27.595578 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:27.596213 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:27.596820 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.596840 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.598299 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.598303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.612216 (+ 13913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.612248 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.616695 (+ 4447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.616705 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.617011 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.618545 (+ 1534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:27.618581 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:27.624197 (+ 5616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:27.633838 (+ 9641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:27.633844 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:27.633847 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:27.635291 (+ 1444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:27.635769 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:27.635777 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:27.635781 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:27.635987 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:27.639156 (+ 3169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:27.639162 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:27.639375 (+ 213us) client_negotiation.cc:769] Sending connection context
0812 00:21:27.639524 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 00:21:27.639872 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6917,"mutex_wait_us":130,"spinlock_wait_cycles":23168,"thread_start_us":12645,"threads_started":1}
I20260812 00:21:27.640774 27505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.580266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:52569 (local address 127.18.163.254:35307)
0812 00:21:27.592859 (+ 12593us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:27.592869 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:27.592897 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:21:27.592978 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:27.592986 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:27.593086 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:27.593231 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:27.597056 (+ 3825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.598108 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.614890 (+ 16782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.615972 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.616154 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.629565 (+ 13411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:27.629594 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:27.629599 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:27.629647 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:27.633546 (+ 3899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:27.635435 (+ 1889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:27.635442 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:27.635446 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:27.635609 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:27.636163 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:27.636171 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:27.636175 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:27.636593 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:27.636768 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:27.640078 (+ 3310us) server_negotiation.cc:299] Negotiation successful
0812 00:21:27.640347 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12403,"thread_start_us":13103,"threads_started":1}
I20260812 00:21:27.641932 27500 heartbeater.cc:347] Connected to a master server at 127.18.163.254:35307
I20260812 00:21:27.642138 27500 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:27.642716 27500 heartbeater.cc:511] Master 127.18.163.254:35307 requested a full tablet report, sending...
I20260812 00:21:27.644657 26080 ts_manager.cc:194] Re-registered known tserver with Master: bbed97135e09454083b90c16e90b7475 (127.18.163.195:46691)
I20260812 00:21:27.646474 26080 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:52569
I20260812 00:21:27.650350 27519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.600409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34544 (local address 127.18.163.253:39737)
0812 00:21:27.615866 (+ 15457us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:27.615872 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:27.615897 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:21:27.625659 (+ 9762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:27.625665 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:27.625745 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:27.629231 (+ 3486us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:27.629554 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.630756 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.632876 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.633613 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.633750 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.641427 (+ 7677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:27.641433 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:27.641436 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:27.641477 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:27.645559 (+ 4082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:27.647411 (+ 1852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:27.647418 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:27.647421 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:27.647657 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:27.648238 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:27.648244 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:27.648247 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:27.648636 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:27.648871 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:27.649771 (+ 900us) server_negotiation.cc:299] Negotiation successful
0812 00:21:27.650045 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15161,"thread_start_us":15257,"threads_started":1}
I20260812 00:21:27.656688 27520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.600584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44556 (local address 127.18.163.252:40263)
0812 00:21:27.607524 (+ 6940us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:27.607530 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:27.622850 (+ 15320us) server_negotiation.cc:407] Connection header received
0812 00:21:27.624779 (+ 1929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:27.624788 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:27.624888 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:27.624992 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:27.636192 (+ 11200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.637525 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.644252 (+ 6727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.644969 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.645095 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.650329 (+ 5234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:27.650335 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:27.650339 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:27.650376 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:27.653711 (+ 3335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:27.654495 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:27.654502 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:27.654505 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:27.654691 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:27.655106 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:27.655111 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:27.655115 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:27.655421 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:27.655703 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:27.656093 (+ 390us) server_negotiation.cc:299] Negotiation successful
0812 00:21:27.656329 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6768,"thread_start_us":6632,"threads_started":1}
I20260812 00:21:27.658105 27514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.598727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57414 (local address 127.18.163.254:35307)
0812 00:21:27.629158 (+ 30431us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:27.629165 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:27.629187 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:21:27.629254 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:27.629259 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:27.634784 (+ 5525us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:27.634912 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:27.637724 (+ 2812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.638962 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.641918 (+ 2956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.642675 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.642821 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.651201 (+ 8380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:27.651206 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:27.651209 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:27.651245 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:27.654390 (+ 3145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:27.655690 (+ 1300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:27.655696 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:27.655702 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:27.655842 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:27.656281 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:27.656286 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:27.656291 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:27.656668 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:27.656943 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:27.657387 (+ 444us) server_negotiation.cc:299] Negotiation successful
0812 00:21:27.657671 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30273,"thread_start_us":30114,"threads_started":1}
I20260812 00:21:27.662871 26080 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57414:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:21:27.670789 26080 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:21:27.704250 27533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.694835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42982 (local address 127.18.163.194:43693)
0812 00:21:27.695931 (+ 1096us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:27.695946 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:27.696016 (+ 70us) server_negotiation.cc:407] Connection header received
0812 00:21:27.696159 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:27.696172 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:27.696542 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:27.696785 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:27.697979 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.699609 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.701898 (+ 2289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.703178 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.703388 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.703606 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:27.703775 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 00:21:27.703947 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":941,"thread_start_us":832,"threads_started":1}
I20260812 00:21:27.704653 27532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.694560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:43693 (local address 127.0.0.1:42982)
0812 00:21:27.695278 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:27.695303 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:27.695450 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:27.696798 (+ 1348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:27.696807 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:27.696851 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:27.697733 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.697758 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.699759 (+ 2001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.699765 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.701736 (+ 1971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.701750 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.703404 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.703411 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.703585 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.703620 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 00:21:27.703718 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 00:21:27.703869 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":349,"threads_started":1}
I20260812 00:21:27.709134 27267 tablet_service.cc:1467] Processing CreateTablet for tablet a3f17bcf089342fcb0837d71b01a9cc4 (DEFAULT_TABLE table=test-table [id=34afe7c03d684efc80decfd2d57c6879]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:27.710848 27267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3f17bcf089342fcb0837d71b01a9cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:27.711151 27537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.698234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:46691 (local address 127.0.0.1:60354)
0812 00:21:27.698845 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:27.698860 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:27.699016 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:27.700535 (+ 1519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:27.700547 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:27.700570 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:27.701006 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.701019 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.703854 (+ 2835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.703861 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.706913 (+ 3052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.706926 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.709817 (+ 2891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.709824 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.710023 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.710071 (+ 48us) client_negotiation.cc:769] Sending connection context
0812 00:21:27.710201 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 00:21:27.710363 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"mutex_wait_us":79,"thread_start_us":328,"threads_started":1}
I20260812 00:21:27.711202 27536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.695427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35846 (local address 127.18.163.193:46795)
0812 00:21:27.697429 (+ 2002us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:27.697438 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:27.698275 (+ 837us) server_negotiation.cc:407] Connection header received
0812 00:21:27.699573 (+ 1298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:27.699580 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:27.699846 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:27.700064 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:27.702562 (+ 2498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.703647 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.706909 (+ 3262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.708082 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.708218 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.708352 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:27.710655 (+ 2303us) server_negotiation.cc:299] Negotiation successful
0812 00:21:27.710857 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1793,"thread_start_us":1780,"threads_started":1}
I20260812 00:21:27.711918 27538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.698635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60354 (local address 127.18.163.195:46691)
0812 00:21:27.699386 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:27.699392 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:27.699418 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:21:27.699550 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:27.699558 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:27.699846 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:27.700064 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:27.701270 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.702596 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.708458 (+ 5862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.709517 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.709798 (+ 281us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.710003 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:27.710280 (+ 277us) server_negotiation.cc:299] Negotiation successful
0812 00:21:27.710481 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":423,"threads_started":1}
I20260812 00:21:27.711997 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.695051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:46795 (local address 127.0.0.1:35846)
0812 00:21:27.698125 (+ 3074us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:27.698148 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:27.699366 (+ 1218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:27.701921 (+ 2555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:27.701928 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:27.701956 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:27.702344 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.702356 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.703799 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.703805 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.706686 (+ 2881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.706703 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.710213 (+ 3510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.710219 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.710381 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.710412 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 00:21:27.711471 (+ 1059us) client_negotiation.cc:240] Negotiation successful
0812 00:21:27.711605 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2929,"mutex_wait_us":136,"thread_start_us":2667,"threads_started":1}
I20260812 00:21:27.716150 27426 tablet_service.cc:1467] Processing CreateTablet for tablet a3f17bcf089342fcb0837d71b01a9cc4 (DEFAULT_TABLE table=test-table [id=34afe7c03d684efc80decfd2d57c6879]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:27.716199 27107 tablet_service.cc:1467] Processing CreateTablet for tablet a3f17bcf089342fcb0837d71b01a9cc4 (DEFAULT_TABLE table=test-table [id=34afe7c03d684efc80decfd2d57c6879]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:27.717747 27426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3f17bcf089342fcb0837d71b01a9cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:27.717903 27107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3f17bcf089342fcb0837d71b01a9cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:27.729306 27539 tablet_bootstrap.cc:492] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1: Bootstrap starting.
I20260812 00:21:27.732029 27542 tablet_bootstrap.cc:492] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475: Bootstrap starting.
I20260812 00:21:27.733457 27539 tablet_bootstrap.cc:654] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:27.734589 27543 tablet_bootstrap.cc:492] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940: Bootstrap starting.
I20260812 00:21:27.736013 27542 tablet_bootstrap.cc:654] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:27.736492 27539 log.cc:824] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:27.737079 27542 log.cc:824] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:27.738607 27543 tablet_bootstrap.cc:654] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:27.739704 27543 log.cc:824] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:27.740330 27539 tablet_bootstrap.cc:492] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1: No bootstrap required, opened a new log
I20260812 00:21:27.740324 27542 tablet_bootstrap.cc:492] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475: No bootstrap required, opened a new log
I20260812 00:21:27.740648 27539 ts_tablet_manager.cc:1397] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.000s
I20260812 00:21:27.740648 27542 ts_tablet_manager.cc:1397] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260812 00:21:27.742758 27543 tablet_bootstrap.cc:492] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940: No bootstrap required, opened a new log
I20260812 00:21:27.743070 27543 ts_tablet_manager.cc:1397] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260812 00:21:27.751070 27543 raft_consensus.cc:348] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } } peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } }
I20260812 00:21:27.751518 27543 raft_consensus.cc:374] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:27.751621 27543 raft_consensus.cc:729] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2032db1dcec4456783180ee086ed6940, State: Initialized, Role: FOLLOWER
I20260812 00:21:27.752326 27543 consensus_queue.cc:260] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } } peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } }
I20260812 00:21:27.752269 27539 raft_consensus.cc:348] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } } peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } }
I20260812 00:21:27.752755 27539 raft_consensus.cc:374] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:27.752880 27539 raft_consensus.cc:729] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf032d1d952d46ceb0695d05b37e8ca1, State: Initialized, Role: FOLLOWER
I20260812 00:21:27.752672 27542 raft_consensus.cc:348] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } } peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } }
I20260812 00:21:27.753166 27542 raft_consensus.cc:374] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:27.753294 27542 raft_consensus.cc:729] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbed97135e09454083b90c16e90b7475, State: Initialized, Role: FOLLOWER
I20260812 00:21:27.753741 27539 consensus_queue.cc:260] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } } peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } }
I20260812 00:21:27.753957 27542 consensus_queue.cc:260] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } } peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } }
I20260812 00:21:27.754729 27543 ts_tablet_manager.cc:1428] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260812 00:21:27.758136 27542 ts_tablet_manager.cc:1428] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475: Time spent starting tablet: real 0.017s user 0.019s sys 0.000s
I20260812 00:21:27.758811 27500 heartbeater.cc:503] Master 127.18.163.254:35307 was elected leader, sending a full tablet report...
I20260812 00:21:27.758971 27342 heartbeater.cc:503] Master 127.18.163.254:35307 was elected leader, sending a full tablet report...
I20260812 00:21:27.766088 27539 ts_tablet_manager.cc:1428] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1: Time spent starting tablet: real 0.025s user 0.015s sys 0.004s
W20260812 00:21:27.835408 27502 tablet.cc:2369] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:21:27.856678 27551 raft_consensus.cc:482] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:21:27.856956 27551 raft_consensus.cc:504] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } } peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } }
I20260812 00:21:27.857904 27548 raft_consensus.cc:482] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:21:27.858233 27548 raft_consensus.cc:504] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } } peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } }
I20260812 00:21:27.859688 27551 leader_election.cc:288] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf032d1d952d46ceb0695d05b37e8ca1 (127.18.163.194:43693), 2032db1dcec4456783180ee086ed6940 (127.18.163.193:46795)
I20260812 00:21:27.868892 27512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.859419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:43693 (local address 127.18.163.195:47153)
0812 00:21:27.859732 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:27.859754 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:27.859922 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:27.860656 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:27.860664 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:27.860697 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:27.860899 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.860912 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.862613 (+ 1701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.862622 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.865380 (+ 2758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.865402 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.867819 (+ 2417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.867827 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.868119 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.868169 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 00:21:27.868276 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 00:21:27.868476 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":7}
I20260812 00:21:27.869719 27533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.859652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:47153 (local address 127.18.163.194:43693)
0812 00:21:27.860133 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:27.860139 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:27.860163 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:21:27.860246 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:27.860253 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:27.860343 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:27.860433 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:27.861087 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.862416 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.865724 (+ 3308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.867404 (+ 1680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.867573 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.867699 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:27.869153 (+ 1454us) server_negotiation.cc:299] Negotiation successful
0812 00:21:27.869342 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319}
I20260812 00:21:27.870235 27536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.860211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:36309 (local address 127.18.163.193:46795)
0812 00:21:27.860416 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:27.860422 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:27.860442 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:21:27.860511 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:27.860518 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:27.860621 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:27.860737 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:27.861802 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.863349 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.866727 (+ 3378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.868636 (+ 1909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.868854 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.868962 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:27.869681 (+ 719us) server_negotiation.cc:299] Negotiation successful
0812 00:21:27.869862 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:21:27.870999 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.859455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:46795 (local address 127.18.163.195:36309)
0812 00:21:27.859847 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:27.859862 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:27.859932 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:27.860992 (+ 1060us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:27.861001 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:27.861040 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:27.861338 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.861353 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.863573 (+ 2220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.863582 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.866387 (+ 2805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.866410 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.869132 (+ 2722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.869138 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.869414 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.869469 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 00:21:27.870497 (+ 1028us) client_negotiation.cc:240] Negotiation successful
0812 00:21:27.870712 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":47}
I20260812 00:21:27.871734 27287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3f17bcf089342fcb0837d71b01a9cc4" candidate_uuid: "bbed97135e09454083b90c16e90b7475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" is_pre_election: true
I20260812 00:21:27.872062 27548 leader_election.cc:288] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf032d1d952d46ceb0695d05b37e8ca1 (127.18.163.194:43693), bbed97135e09454083b90c16e90b7475 (127.18.163.195:46691)
I20260812 00:21:27.872175 27128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3f17bcf089342fcb0837d71b01a9cc4" candidate_uuid: "bbed97135e09454083b90c16e90b7475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2032db1dcec4456783180ee086ed6940" is_pre_election: true
I20260812 00:21:27.872463 27287 raft_consensus.cc:2454] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbed97135e09454083b90c16e90b7475 in term 0.
I20260812 00:21:27.872820 27128 raft_consensus.cc:2454] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbed97135e09454083b90c16e90b7475 in term 0.
I20260812 00:21:27.873620 27375 leader_election.cc:302] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2032db1dcec4456783180ee086ed6940, bbed97135e09454083b90c16e90b7475, cf032d1d952d46ceb0695d05b37e8ca1; no voters:
I20260812 00:21:27.874459 27551 raft_consensus.cc:2781] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:21:27.874656 27551 raft_consensus.cc:482] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:21:27.874797 27551 raft_consensus.cc:3037] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:27.879046 27551 raft_consensus.cc:504] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } } peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } }
I20260812 00:21:27.880381 27128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3f17bcf089342fcb0837d71b01a9cc4" candidate_uuid: "bbed97135e09454083b90c16e90b7475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2032db1dcec4456783180ee086ed6940"
I20260812 00:21:27.880386 27287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3f17bcf089342fcb0837d71b01a9cc4" candidate_uuid: "bbed97135e09454083b90c16e90b7475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf032d1d952d46ceb0695d05b37e8ca1"
I20260812 00:21:27.880638 27287 raft_consensus.cc:3037] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:27.880638 27128 raft_consensus.cc:3037] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:27.884227 27128 raft_consensus.cc:2454] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed97135e09454083b90c16e90b7475 in term 1.
I20260812 00:21:27.884354 27287 raft_consensus.cc:2454] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed97135e09454083b90c16e90b7475 in term 1.
W20260812 00:21:27.884883 27344 tablet.cc:2369] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:21:27.884913 27375 leader_election.cc:302] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbed97135e09454083b90c16e90b7475, cf032d1d952d46ceb0695d05b37e8ca1; no voters:
I20260812 00:21:27.886106 27551 leader_election.cc:288] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [CANDIDATE]: Term 1 election: Requested vote from peers cf032d1d952d46ceb0695d05b37e8ca1 (127.18.163.194:43693), 2032db1dcec4456783180ee086ed6940 (127.18.163.193:46795)
I20260812 00:21:27.886404 27551 raft_consensus.cc:2781] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:27.886585 27551 raft_consensus.cc:686] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [term 1 LEADER]: Becoming Leader. State: Replica: bbed97135e09454083b90c16e90b7475, State: Running, Role: LEADER
I20260812 00:21:27.886847 27533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.860912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:44149 (local address 127.18.163.194:43693)
0812 00:21:27.870197 (+ 9285us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:27.870205 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:27.873415 (+ 3210us) server_negotiation.cc:407] Connection header received
0812 00:21:27.873777 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:27.873786 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:27.873885 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:27.873963 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:27.875241 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.876475 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.882049 (+ 5574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.883490 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.883623 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.883707 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:27.886380 (+ 2673us) server_negotiation.cc:299] Negotiation successful
0812 00:21:27.886536 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9151,"thread_start_us":18440,"threads_started":1}
I20260812 00:21:27.887146 27551 consensus_queue.cc:237] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } } peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } }
I20260812 00:21:27.888226 27554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.860350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:43693 (local address 127.18.163.193:44149)
0812 00:21:27.873284 (+ 12934us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:27.873312 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:27.873554 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:27.874320 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:27.874327 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:27.874368 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:27.875035 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.875050 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.876688 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.876695 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.881190 (+ 4495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.881207 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.883956 (+ 2749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.883963 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.884152 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.884186 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:21:27.887162 (+ 2976us) client_negotiation.cc:240] Negotiation successful
0812 00:21:27.887324 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10528,"mutex_wait_us":3,"spinlock_wait_cycles":49536,"thread_start_us":16988,"threads_started":1}
I20260812 00:21:27.888897 27538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.861421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:58951 (local address 127.18.163.195:46691)
0812 00:21:27.861684 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:27.861692 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:27.874439 (+ 12747us) server_negotiation.cc:407] Connection header received
0812 00:21:27.874790 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:27.874797 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:27.874887 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:27.874953 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:27.875744 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.877083 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.884365 (+ 7282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.885726 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.885853 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.885924 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:27.888496 (+ 2572us) server_negotiation.cc:299] Negotiation successful
0812 00:21:27.888671 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 00:21:27.891664 27552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.860430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:46691 (local address 127.18.163.193:58951)
0812 00:21:27.874321 (+ 13891us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:27.874342 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:27.874585 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:27.875166 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:27.875170 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:27.875198 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:27.875556 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.875574 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.877293 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.877299 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.881857 (+ 4558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:27.881872 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.887532 (+ 5660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.887538 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:27.887748 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.887783 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 00:21:27.891073 (+ 3290us) client_negotiation.cc:240] Negotiation successful
0812 00:21:27.891238 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13758,"mutex_wait_us":655,"thread_start_us":10244,"threads_started":1}
I20260812 00:21:27.892856 27287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3f17bcf089342fcb0837d71b01a9cc4" candidate_uuid: "2032db1dcec4456783180ee086ed6940" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" is_pre_election: true
I20260812 00:21:27.893369 27287 raft_consensus.cc:2379] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2032db1dcec4456783180ee086ed6940 in current term 1: Already voted for candidate bbed97135e09454083b90c16e90b7475 in this term.
I20260812 00:21:27.893107 27450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3f17bcf089342fcb0837d71b01a9cc4" candidate_uuid: "2032db1dcec4456783180ee086ed6940" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbed97135e09454083b90c16e90b7475" is_pre_election: true
I20260812 00:21:27.894448 27054 leader_election.cc:302] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2032db1dcec4456783180ee086ed6940; no voters: bbed97135e09454083b90c16e90b7475, cf032d1d952d46ceb0695d05b37e8ca1
I20260812 00:21:27.895001 27548 raft_consensus.cc:2726] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 00:21:27.898166 26077 catalog_manager.cc:5495] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 reported cstate change: term changed from 0 to 1, leader changed from <none> to bbed97135e09454083b90c16e90b7475 (127.18.163.195). New cstate: current_term: 1 leader_uuid: "bbed97135e09454083b90c16e90b7475" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } health_report { overall_health: HEALTHY } } }
I20260812 00:21:27.949898 27538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:27.944512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60368 (local address 127.18.163.195:46691)
0812 00:21:27.944704 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:27.944709 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:27.944727 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:21:27.944848 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:27.944852 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:27.944947 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:27.945071 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:21:27.945412 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.946249 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.947678 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:27.948100 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:27.948195 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:27.948656 (+ 461us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:21:27.949230 (+ 574us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:21:27.949363 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:27.949469 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 00:21:27.949547 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 00:21:27.958617 27287 raft_consensus.cc:1261] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1 [term 1 FOLLOWER]: Refusing update from remote peer bbed97135e09454083b90c16e90b7475: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:27.958645 27128 raft_consensus.cc:1261] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940 [term 1 FOLLOWER]: Refusing update from remote peer bbed97135e09454083b90c16e90b7475: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:27.959635 27556 consensus_queue.cc:1035] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:27.959988 27551 consensus_queue.cc:1035] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 00:21:27.967932 27186 tablet.cc:2369] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:21:27.976532 27560 mvcc.cc:205] Tried to move back new op lower bound from 7317479784267501568 to 7317479783990497280. Current Snapshot: MvccSnapshot[applied={T|T < 7317479784267501568}]
I20260812 00:21:27.977617 27562 mvcc.cc:205] Tried to move back new op lower bound from 7317479784267501568 to 7317479783990497280. Current Snapshot: MvccSnapshot[applied={T|T < 7317479784267501568}]
I20260812 00:21:27.985167 27561 mvcc.cc:205] Tried to move back new op lower bound from 7317479784267501568 to 7317479783990497280. Current Snapshot: MvccSnapshot[applied={T|T < 7317479784267501568}]
I20260812 00:21:27.995285 26077 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:21:27.995642 26077 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:21:28.002925 26077 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 16e941ca289a44a9a99608abd9bb8230: Sending DeleteTablet for 3 replicas of tablet a3f17bcf089342fcb0837d71b01a9cc4
I20260812 00:21:28.005014 27107 tablet_service.cc:1514] Processing DeleteTablet for tablet a3f17bcf089342fcb0837d71b01a9cc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:27 UTC) from {username='oryx', principal='oryx/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:35846
I20260812 00:21:28.005389 27426 tablet_service.cc:1514] Processing DeleteTablet for tablet a3f17bcf089342fcb0837d71b01a9cc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:27 UTC) from {username='oryx', principal='oryx/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:60354
I20260812 00:21:28.006296 27574 tablet_replica.cc:330] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940: stopping tablet replica
I20260812 00:21:28.006824 27574 raft_consensus.cc:2229] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:28.007828 27574 raft_consensus.cc:2258] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:28.008159 27267 tablet_service.cc:1514] Processing DeleteTablet for tablet a3f17bcf089342fcb0837d71b01a9cc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:27 UTC) from {username='oryx', principal='oryx/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:42982
I20260812 00:21:28.010691 27574 ts_tablet_manager.cc:1905] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:28.011106 27266 tablet_service.cc:1514] Processing DeleteTablet for tablet a3f17bcf089342fcb0837d71b01a9cc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:27 UTC) from {username='oryx', principal='oryx/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:42982
I20260812 00:21:28.014102 27577 tablet_replica.cc:330] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1: stopping tablet replica
I20260812 00:21:28.014691 27577 raft_consensus.cc:2229] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:28.015372 27577 raft_consensus.cc:2258] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:28.015483 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 26040
I20260812 00:21:28.016644 26116 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:28.020578 27574 ts_tablet_manager.cc:1918] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:28.020623 27577 ts_tablet_manager.cc:1905] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:28.020788 27574 log.cc:1196] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/a3f17bcf089342fcb0837d71b01a9cc4
I20260812 00:21:28.021441 27574 ts_tablet_manager.cc:1939] T a3f17bcf089342fcb0837d71b01a9cc4 P 2032db1dcec4456783180ee086ed6940: Deleting consensus metadata
I20260812 00:21:28.029910 27519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:28.007716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34552 (local address 127.18.163.253:39737)
0812 00:21:28.007997 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:28.008003 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:28.008744 (+ 741us) server_negotiation.cc:407] Connection header received
0812 00:21:28.008988 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:28.008993 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:28.009085 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:28.009227 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:28.011835 (+ 2608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:28.012921 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:28.015184 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:28.015858 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:28.015991 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:28.021098 (+ 5107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:28.021108 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:28.021116 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:28.021171 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:28.026078 (+ 4907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:28.027429 (+ 1351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:28.027438 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:28.027445 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:28.027625 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:28.028169 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:28.028176 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:28.028179 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:28.028575 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:28.028858 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:28.029246 (+ 388us) server_negotiation.cc:299] Negotiation successful
0812 00:21:28.029495 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260812 00:21:28.033876 27577 ts_tablet_manager.cc:1918] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:28.034015 27575 tablet_replica.cc:330] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475: stopping tablet replica
I20260812 00:21:28.034129 27577 log.cc:1196] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/a3f17bcf089342fcb0837d71b01a9cc4
I20260812 00:21:28.034614 27575 raft_consensus.cc:2229] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:21:28.034798 27577 ts_tablet_manager.cc:1939] T a3f17bcf089342fcb0837d71b01a9cc4 P cf032d1d952d46ceb0695d05b37e8ca1: Deleting consensus metadata
I20260812 00:21:28.035441 27575 raft_consensus.cc:2258] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:28.037887 27575 ts_tablet_manager.cc:1905] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:28.045864 27575 ts_tablet_manager.cc:1918] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:28.046098 27575 log.cc:1196] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/a3f17bcf089342fcb0837d71b01a9cc4
I20260812 00:21:28.046758 27575 ts_tablet_manager.cc:1939] T a3f17bcf089342fcb0837d71b01a9cc4 P bbed97135e09454083b90c16e90b7475: Deleting consensus metadata
I20260812 00:21:28.049067 27520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:28.008482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44564 (local address 127.18.163.252:40263)
0812 00:21:28.008656 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:28.008662 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:28.030459 (+ 21797us) server_negotiation.cc:407] Connection header received
0812 00:21:28.030758 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:28.030764 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:28.030851 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:28.030930 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:28.032666 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:28.033397 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:28.036125 (+ 2728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:28.036833 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:28.036951 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:28.041069 (+ 4118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:28.041078 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:28.041095 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:28.041150 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:28.045104 (+ 3954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:28.046341 (+ 1237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:28.046350 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:28.046354 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:28.046531 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:28.047112 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:28.047117 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:28.047121 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:28.047513 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:28.047780 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:28.048432 (+ 652us) server_negotiation.cc:299] Negotiation successful
0812 00:21:28.048693 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 00:21:28.160773 26060 catalog_manager.cc:4841] TS 2032db1dcec4456783180ee086ed6940 (127.18.163.193:46795): tablet a3f17bcf089342fcb0837d71b01a9cc4 (table test-table [id=34afe7c03d684efc80decfd2d57c6879]) successfully deleted
W20260812 00:21:28.161123 26060 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.163.193:46795, user_credentials={real_user=slave}} blocked reactor thread for 137263us
I20260812 00:21:28.161655 26060 catalog_manager.cc:4841] TS bbed97135e09454083b90c16e90b7475 (127.18.163.195:46691): tablet a3f17bcf089342fcb0837d71b01a9cc4 (table test-table [id=34afe7c03d684efc80decfd2d57c6879]) successfully deleted
I20260812 00:21:28.161998 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 26040
W20260812 00:21:28.200286 27214 connection.cc:535] server connection from 127.0.0.1:42982 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:21:28.235448 27519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:28.203662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34568 (local address 127.18.163.253:39737)
0812 00:21:28.203873 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:28.203880 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:28.212232 (+ 8352us) server_negotiation.cc:407] Connection header received
0812 00:21:28.213019 (+ 787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:28.213029 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:28.213146 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:28.213243 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:28.222118 (+ 8875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:28.222876 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:28.224558 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:28.225296 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:28.225466 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:28.228852 (+ 3386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:28.228860 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:28.228864 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:28.228910 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:28.231979 (+ 3069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:28.232890 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:28.232895 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:28.232898 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:28.233097 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:28.233636 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:28.233641 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:28.233644 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:28.234083 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:28.234362 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:28.234813 (+ 451us) server_negotiation.cc:299] Negotiation successful
0812 00:21:28.235063 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 00:21:28.238253 27520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:28.211667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44572 (local address 127.18.163.252:40263)
0812 00:21:28.211921 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:28.211928 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:28.221247 (+ 9319us) server_negotiation.cc:407] Connection header received
0812 00:21:28.221442 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:28.221450 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:28.221551 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:28.221694 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:28.224106 (+ 2412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:28.225078 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:28.227561 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:28.228292 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:28.228433 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:28.231675 (+ 3242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:28.231682 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:28.231689 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:28.231734 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:28.235321 (+ 3587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:28.236141 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:28.236146 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:28.236150 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:28.236315 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:28.236760 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:28.236765 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:28.236767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:28.237129 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:28.237319 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:28.237793 (+ 474us) server_negotiation.cc:299] Negotiation successful
0812 00:21:28.237968 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260812 00:21:28.982283 27587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:28.981406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.193:37935)
0812 00:21:28.981971 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:28.982104 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":298,"threads_started":1}
W20260812 00:21:28.982738 27178 heartbeater.cc:644] Failed to heartbeat to 127.18.163.254:35307 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
I20260812 00:21:28.989919 27588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:28.988844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.195:38985)
0812 00:21:28.989385 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:28.989531 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":314,"threads_started":1}
W20260812 00:21:28.990530 27500 heartbeater.cc:644] Failed to heartbeat to 127.18.163.254:35307 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
I20260812 00:21:29.011415 27589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.010638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.194:37281)
0812 00:21:29.011095 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.011226 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":225,"threads_started":1}
W20260812 00:21:29.011861 27342 heartbeater.cc:644] Failed to heartbeat to 127.18.163.254:35307 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
I20260812 00:21:29.504866 27590 raft_consensus.cc:482] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16e941ca289a44a9a99608abd9bb8230)
I20260812 00:21:29.505198 27590 raft_consensus.cc:504] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false } }
I20260812 00:21:29.505343 27591 raft_consensus.cc:482] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16e941ca289a44a9a99608abd9bb8230)
I20260812 00:21:29.505695 27591 raft_consensus.cc:504] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false } }
I20260812 00:21:29.506290 27590 leader_election.cc:288] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16e941ca289a44a9a99608abd9bb8230 (127.18.163.254:35307), a10addcd04f8412b83702e3dd63daaf9 (127.18.163.253:39737)
I20260812 00:21:29.516549 27591 leader_election.cc:288] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16e941ca289a44a9a99608abd9bb8230 (127.18.163.254:35307), 847e3ad1da2e49528bcecb9b8e3fd11e (127.18.163.252:40263)
I20260812 00:21:29.518906 27592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.506494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.0.0.1:57824)
0812 00:21:29.518171 (+ 11677us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.518489 (+ 318us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11493,"threads_started":1}
I20260812 00:21:29.521456 27595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.511671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.0.0.1:57834)
0812 00:21:29.520849 (+ 9178us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.521081 (+ 232us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9048,"thread_start_us":4010,"threads_started":1}
W20260812 00:21:29.522265 26741 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
W20260812 00:21:29.523619 26958 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
I20260812 00:21:29.530403 27595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.528305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.0.0.1:57838)
0812 00:21:29.528812 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.528913 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351}
W20260812 00:21:29.531507 26741 leader_election.cc:334] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16e941ca289a44a9a99608abd9bb8230 (127.18.163.254:35307): Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
I20260812 00:21:29.533593 27596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.507879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40263 (local address 127.0.0.1:44574)
0812 00:21:29.516101 (+ 8222us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.516134 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:29.516354 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:29.524115 (+ 7761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:29.524124 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:29.524169 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:29.524653 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:29.524671 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.527172 (+ 2501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.527182 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:29.530318 (+ 3136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:29.530344 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.532635 (+ 2291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.532641 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:29.532887 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:29.532929 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 00:21:29.532999 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 00:21:29.533171 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8020,"thread_start_us":12549,"threads_started":1}
I20260812 00:21:29.534189 27598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.519525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44574 (local address 127.18.163.252:40263)
0812 00:21:29.523566 (+ 4041us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:29.523575 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:29.523609 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:21:29.523701 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:29.523708 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:29.523825 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:29.524886 (+ 1061us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:29.525281 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.526920 (+ 1639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.530614 (+ 3694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.532426 (+ 1812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.533394 (+ 968us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:29.533629 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:29.533694 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 00:21:29.533846 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":74,"server-negotiator.queue_time_us":3862,"thread_start_us":3742,"threads_started":1}
I20260812 00:21:29.534814 27593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.533641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.0.0.1:57856)
0812 00:21:29.534326 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.534528 (+ 202us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260812 00:21:29.535075 26958 leader_election.cc:334] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16e941ca289a44a9a99608abd9bb8230 (127.18.163.254:35307): Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
I20260812 00:21:29.535005 26984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a10addcd04f8412b83702e3dd63daaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" is_pre_election: true
I20260812 00:21:29.535398 26984 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a10addcd04f8412b83702e3dd63daaf9 in term 1.
I20260812 00:21:29.535914 26740 leader_election.cc:302] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847e3ad1da2e49528bcecb9b8e3fd11e, a10addcd04f8412b83702e3dd63daaf9; no voters: 16e941ca289a44a9a99608abd9bb8230
I20260812 00:21:29.536331 27591 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 00:21:29.536471 27591 raft_consensus.cc:482] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16e941ca289a44a9a99608abd9bb8230)
I20260812 00:21:29.536608 27591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:21:29.539093 27592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.506563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39737 (local address 127.0.0.1:34576)
0812 00:21:29.520758 (+ 14195us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.520781 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:29.520944 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:29.533109 (+ 12165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:29.533114 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:29.533150 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:29.533530 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:29.533549 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.535164 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.535170 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:29.536839 (+ 1669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:29.536853 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.538229 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.538236 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:29.538435 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:29.538460 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 00:21:29.538570 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 00:21:29.538721 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14090,"mutex_wait_us":3,"thread_start_us":16282,"threads_started":1}
I20260812 00:21:29.539114 27594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.506742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34576 (local address 127.18.163.253:39737)
0812 00:21:29.532752 (+ 26010us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:29.532767 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:29.532789 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:21:29.532858 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:29.532862 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:29.532941 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:29.533060 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:29.533801 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.534997 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.536998 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.538020 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.538228 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:29.538310 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:29.538599 (+ 289us) server_negotiation.cc:299] Negotiation successful
0812 00:21:29.538746 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25852,"thread_start_us":25915,"threads_started":1}
I20260812 00:21:29.539222 27591 raft_consensus.cc:504] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false } }
I20260812 00:21:29.539812 26772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a10addcd04f8412b83702e3dd63daaf9" is_pre_election: true
I20260812 00:21:29.540112 27591 leader_election.cc:288] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [CANDIDATE]: Term 2 election: Requested vote from peers 16e941ca289a44a9a99608abd9bb8230 (127.18.163.254:35307), 847e3ad1da2e49528bcecb9b8e3fd11e (127.18.163.252:40263)
I20260812 00:21:29.540169 26772 raft_consensus.cc:2379] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847e3ad1da2e49528bcecb9b8e3fd11e in current term 2: Already voted for candidate a10addcd04f8412b83702e3dd63daaf9 in this term.
I20260812 00:21:29.540738 27596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.540287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.0.0.1:57864)
0812 00:21:29.540470 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.540594 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 00:21:29.540864 26984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a10addcd04f8412b83702e3dd63daaf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e"
I20260812 00:21:29.540959 26957 leader_election.cc:302] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847e3ad1da2e49528bcecb9b8e3fd11e; no voters: 16e941ca289a44a9a99608abd9bb8230, a10addcd04f8412b83702e3dd63daaf9
I20260812 00:21:29.541147 26984 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:21:29.541991 27596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.541560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.0.0.1:57878)
0812 00:21:29.541747 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.541839 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260812 00:21:29.542184 26741 leader_election.cc:334] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16e941ca289a44a9a99608abd9bb8230 (127.18.163.254:35307): Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
I20260812 00:21:29.543821 26984 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10addcd04f8412b83702e3dd63daaf9 in term 2.
I20260812 00:21:29.544018 27590 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:21:29.544334 26740 leader_election.cc:302] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847e3ad1da2e49528bcecb9b8e3fd11e, a10addcd04f8412b83702e3dd63daaf9; no voters: 16e941ca289a44a9a99608abd9bb8230
I20260812 00:21:29.544663 27591 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:21:29.545181 27591 raft_consensus.cc:686] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [term 2 LEADER]: Becoming Leader. State: Replica: a10addcd04f8412b83702e3dd63daaf9, State: Running, Role: LEADER
I20260812 00:21:29.545686 27591 consensus_queue.cc:237] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false } }
I20260812 00:21:29.547892 27602 sys_catalog.cc:455] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a10addcd04f8412b83702e3dd63daaf9. Latest consensus state: current_term: 2 leader_uuid: "a10addcd04f8412b83702e3dd63daaf9" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false } } }
I20260812 00:21:29.548370 27602 sys_catalog.cc:458] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:29.549090 27605 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:21:29.552942 27605 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:21:29.553923 27605 catalog_manager.cc:1259] Loaded cluster ID: 948a8bfb8dc64a31b2e6944f04b6502d
I20260812 00:21:29.554004 27605 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:21:29.555236 27605 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:21:29.556095 27605 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: Loaded TSK: 0
I20260812 00:21:29.557003 27605 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:21:29.589059 26757 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34568:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:21:29.596738 26757 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:21:29.601630 27596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.601096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.0.0.1:57884)
0812 00:21:29.601280 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.601400 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 00:21:29.601846 26984 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [term 2 FOLLOWER]: Refusing update from remote peer a10addcd04f8412b83702e3dd63daaf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260812 00:21:29.602687 27602 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260812 00:21:29.602857 27596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.602408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.0.0.1:57892)
0812 00:21:29.602628 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.602711 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260812 00:21:29.603058 26741 consensus_peers.cc:487] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 -> Peer 16e941ca289a44a9a99608abd9bb8230 (127.18.163.254:35307): Couldn't send request to peer 16e941ca289a44a9a99608abd9bb8230. Status: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 00:21:29.605772 27590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a10addcd04f8412b83702e3dd63daaf9. Latest consensus state: current_term: 2 leader_uuid: "a10addcd04f8412b83702e3dd63daaf9" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false } } }
I20260812 00:21:29.606082 27590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:21:29.607949 27602 sys_catalog.cc:455] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "a10addcd04f8412b83702e3dd63daaf9" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false } } }
I20260812 00:21:29.608330 27602 sys_catalog.cc:458] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:29.608562 27590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "a10addcd04f8412b83702e3dd63daaf9" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "16e941ca289a44a9a99608abd9bb8230" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35307 } } peers { permanent_uuid: "a10addcd04f8412b83702e3dd63daaf9" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39737 } attrs { promote: false } } peers { permanent_uuid: "847e3ad1da2e49528bcecb9b8e3fd11e" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40263 } attrs { promote: false } } }
I20260812 00:21:29.608822 27607 mvcc.cc:205] Tried to move back new op lower bound from 7317479791000125440 to 7317479790783270912. Current Snapshot: MvccSnapshot[applied={T|T < 7317479791000125440}]
I20260812 00:21:29.608884 27590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 847e3ad1da2e49528bcecb9b8e3fd11e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:21:29.641412 27615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.620277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42986 (local address 127.18.163.194:43693)
0812 00:21:29.634064 (+ 13787us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:29.634071 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:29.634096 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:21:29.634174 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:29.634180 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:29.634258 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:29.634369 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:29.635290 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.636410 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.639012 (+ 2602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.640278 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.640477 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:29.640569 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:29.640932 (+ 363us) server_negotiation.cc:299] Negotiation successful
0812 00:21:29.641085 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13641,"thread_start_us":13544,"threads_started":1}
I20260812 00:21:29.641455 27614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.620034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:43693 (local address 127.0.0.1:42986)
0812 00:21:29.631797 (+ 11763us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.631828 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:29.631974 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:29.634598 (+ 2624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:29.634605 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:29.634638 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:29.635074 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:29.635091 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.636593 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.636600 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:29.638839 (+ 2239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:29.638856 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.640540 (+ 1684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.640547 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:29.640732 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:29.640762 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 00:21:29.640891 (+ 129us) client_negotiation.cc:240] Negotiation successful
0812 00:21:29.641045 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11581,"thread_start_us":11973,"threads_started":1}
I20260812 00:21:29.643793 27267 tablet_service.cc:1467] Processing CreateTablet for tablet 4f516a7792f947e7bd2c83e28ac812ca (DEFAULT_TABLE table=test-table [id=ef2da893bc82469f90686e3b27008fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:29.644415 27267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f516a7792f947e7bd2c83e28ac812ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:29.645256 27595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.619864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:46795 (local address 127.0.0.1:35856)
0812 00:21:29.620248 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.620266 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:29.620406 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:29.638358 (+ 17952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:29.638363 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:29.638402 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:29.638732 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:29.638741 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.640204 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.640210 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:29.642457 (+ 2247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:29.642475 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.644346 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.644353 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:29.644580 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:29.644620 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 00:21:29.644702 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 00:21:29.644870 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267}
I20260812 00:21:29.646215 27613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.619971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35856 (local address 127.18.163.193:46795)
0812 00:21:29.638040 (+ 18069us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:29.638045 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:29.638064 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:21:29.638128 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:29.638131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:29.638193 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:29.638335 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:29.638924 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.640024 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.642673 (+ 2649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.644050 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.645772 (+ 1722us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:29.645836 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:29.645887 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 00:21:29.646001 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17937,"thread_start_us":17824,"threads_started":1}
I20260812 00:21:29.647056 27107 tablet_service.cc:1467] Processing CreateTablet for tablet 4f516a7792f947e7bd2c83e28ac812ca (DEFAULT_TABLE table=test-table [id=ef2da893bc82469f90686e3b27008fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:29.647804 27107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f516a7792f947e7bd2c83e28ac812ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:29.655081 27616 tablet_bootstrap.cc:492] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1: Bootstrap starting.
I20260812 00:21:29.656567 27619 tablet_bootstrap.cc:492] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940: Bootstrap starting.
I20260812 00:21:29.657104 27616 tablet_bootstrap.cc:654] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:29.658391 27596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.618902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:46691 (local address 127.0.0.1:60372)
0812 00:21:29.619070 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.619090 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:29.619197 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:29.648918 (+ 29721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:29.648924 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:29.648960 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:29.649175 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:29.649187 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.650893 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.650899 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:29.654950 (+ 4051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:29.654973 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.657483 (+ 2510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.657492 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:29.657757 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:29.657815 (+ 58us) client_negotiation.cc:769] Sending connection context
0812 00:21:29.657929 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 00:21:29.658087 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 00:21:29.658527 27619 tablet_bootstrap.cc:654] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:29.658676 27612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.619098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60372 (local address 127.18.163.195:46691)
0812 00:21:29.648399 (+ 29301us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:29.648406 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:29.648428 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:21:29.648502 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:29.648508 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:29.648599 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:29.649348 (+ 749us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:29.649555 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.650701 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.655876 (+ 5175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.657249 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.657456 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:29.657561 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:29.658004 (+ 443us) server_negotiation.cc:299] Negotiation successful
0812 00:21:29.658187 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29155,"thread_start_us":29618,"threads_started":1}
I20260812 00:21:29.659730 27426 tablet_service.cc:1467] Processing CreateTablet for tablet 4f516a7792f947e7bd2c83e28ac812ca (DEFAULT_TABLE table=test-table [id=ef2da893bc82469f90686e3b27008fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:29.660279 27426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f516a7792f947e7bd2c83e28ac812ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:29.660969 27616 tablet_bootstrap.cc:492] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1: No bootstrap required, opened a new log
I20260812 00:21:29.661139 27616 ts_tablet_manager.cc:1397] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 00:21:29.661176 27619 tablet_bootstrap.cc:492] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940: No bootstrap required, opened a new log
I20260812 00:21:29.661352 27619 ts_tablet_manager.cc:1397] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 00:21:29.662112 27619 raft_consensus.cc:348] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } } peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } }
I20260812 00:21:29.662056 27616 raft_consensus.cc:348] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } } peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } }
I20260812 00:21:29.662345 27619 raft_consensus.cc:374] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:29.662344 27616 raft_consensus.cc:374] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:29.662441 27616 raft_consensus.cc:729] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf032d1d952d46ceb0695d05b37e8ca1, State: Initialized, Role: FOLLOWER
I20260812 00:21:29.662443 27619 raft_consensus.cc:729] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2032db1dcec4456783180ee086ed6940, State: Initialized, Role: FOLLOWER
I20260812 00:21:29.662729 27619 consensus_queue.cc:260] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } } peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } }
I20260812 00:21:29.662741 27616 consensus_queue.cc:260] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } } peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } }
I20260812 00:21:29.663715 27619 ts_tablet_manager.cc:1428] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:21:29.664335 27616 ts_tablet_manager.cc:1428] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:21:29.669026 27343 heartbeater.cc:503] Master 127.18.163.253:39737 was elected leader, sending a full tablet report...
I20260812 00:21:29.670248 27626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.668835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.193:40819)
0812 00:21:29.669808 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.669972 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":611,"threads_started":1}
I20260812 00:21:29.672713 27179 heartbeater.cc:503] Master 127.18.163.253:39737 was elected leader, sending a full tablet report...
I20260812 00:21:29.674048 27626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.672398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.193:52377)
0812 00:21:29.673767 (+ 1369us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.673875 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1242}
I20260812 00:21:29.675607 27624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.664934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.194:39131)
0812 00:21:29.675054 (+ 10120us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.675306 (+ 252us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9991,"thread_start_us":10189,"threads_started":1}
I20260812 00:21:29.676844 27624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.676208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.194:46871)
0812 00:21:29.676592 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.676698 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"threads_started":1}
I20260812 00:21:29.677624 27625 tablet_bootstrap.cc:492] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475: Bootstrap starting.
I20260812 00:21:29.679198 27625 tablet_bootstrap.cc:654] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:29.681308 27625 tablet_bootstrap.cc:492] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475: No bootstrap required, opened a new log
I20260812 00:21:29.681519 27625 ts_tablet_manager.cc:1397] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260812 00:21:29.682354 27625 raft_consensus.cc:348] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } } peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } }
I20260812 00:21:29.682545 27625 raft_consensus.cc:374] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:29.682682 27625 raft_consensus.cc:729] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbed97135e09454083b90c16e90b7475, State: Initialized, Role: FOLLOWER
I20260812 00:21:29.682933 27625 consensus_queue.cc:260] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } } peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } }
I20260812 00:21:29.684217 27625 ts_tablet_manager.cc:1428] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:21:29.686312 27501 heartbeater.cc:503] Master 127.18.163.253:39737 was elected leader, sending a full tablet report...
I20260812 00:21:29.686825 27630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.684155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.195:55865)
0812 00:21:29.686162 (+ 2007us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.686482 (+ 320us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1839,"thread_start_us":1691,"threads_started":1}
I20260812 00:21:29.687970 27630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.687542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.195:51377)
0812 00:21:29.687710 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.687805 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 00:21:29.774634 27629 raft_consensus.cc:482] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:21:29.774896 27629 raft_consensus.cc:504] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } } peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } }
I20260812 00:21:29.775774 27629 leader_election.cc:288] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf032d1d952d46ceb0695d05b37e8ca1 (127.18.163.194:43693), 2032db1dcec4456783180ee086ed6940 (127.18.163.193:46795)
I20260812 00:21:29.776456 27128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f516a7792f947e7bd2c83e28ac812ca" candidate_uuid: "bbed97135e09454083b90c16e90b7475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2032db1dcec4456783180ee086ed6940" is_pre_election: true
I20260812 00:21:29.776737 27128 raft_consensus.cc:2454] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbed97135e09454083b90c16e90b7475 in term 0.
I20260812 00:21:29.776638 27287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f516a7792f947e7bd2c83e28ac812ca" candidate_uuid: "bbed97135e09454083b90c16e90b7475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" is_pre_election: true
I20260812 00:21:29.776954 27287 raft_consensus.cc:2454] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbed97135e09454083b90c16e90b7475 in term 0.
I20260812 00:21:29.777426 27376 leader_election.cc:302] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2032db1dcec4456783180ee086ed6940, bbed97135e09454083b90c16e90b7475; no voters:
I20260812 00:21:29.777858 27629 raft_consensus.cc:2781] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:21:29.778033 27629 raft_consensus.cc:482] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:21:29.778136 27629 raft_consensus.cc:3037] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:29.780766 27629 raft_consensus.cc:504] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } } peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } }
I20260812 00:21:29.781415 27629 leader_election.cc:288] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [CANDIDATE]: Term 1 election: Requested vote from peers cf032d1d952d46ceb0695d05b37e8ca1 (127.18.163.194:43693), 2032db1dcec4456783180ee086ed6940 (127.18.163.193:46795)
I20260812 00:21:29.782083 27287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f516a7792f947e7bd2c83e28ac812ca" candidate_uuid: "bbed97135e09454083b90c16e90b7475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf032d1d952d46ceb0695d05b37e8ca1"
I20260812 00:21:29.782112 27128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f516a7792f947e7bd2c83e28ac812ca" candidate_uuid: "bbed97135e09454083b90c16e90b7475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2032db1dcec4456783180ee086ed6940"
I20260812 00:21:29.782299 27287 raft_consensus.cc:3037] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:29.782357 27128 raft_consensus.cc:3037] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:29.784518 27128 raft_consensus.cc:2454] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed97135e09454083b90c16e90b7475 in term 1.
I20260812 00:21:29.784518 27287 raft_consensus.cc:2454] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed97135e09454083b90c16e90b7475 in term 1.
I20260812 00:21:29.785064 27376 leader_election.cc:302] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2032db1dcec4456783180ee086ed6940, bbed97135e09454083b90c16e90b7475; no voters:
I20260812 00:21:29.785454 27629 raft_consensus.cc:2781] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:29.785950 27629 raft_consensus.cc:686] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [term 1 LEADER]: Becoming Leader. State: Replica: bbed97135e09454083b90c16e90b7475, State: Running, Role: LEADER
I20260812 00:21:29.786326 27629 consensus_queue.cc:237] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } } peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } }
I20260812 00:21:29.787129 27630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.786691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.195:47547)
0812 00:21:29.786845 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.786981 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 00:21:29.789418 26757 catalog_manager.cc:5495] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 reported cstate change: term changed from 0 to 1, leader changed from <none> to bbed97135e09454083b90c16e90b7475 (127.18.163.195). New cstate: current_term: 1 leader_uuid: "bbed97135e09454083b90c16e90b7475" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed97135e09454083b90c16e90b7475" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 46691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 } health_report { overall_health: UNKNOWN } } }
I20260812 00:21:29.829737 27612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.824640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60378 (local address 127.18.163.195:46691)
0812 00:21:29.824842 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:29.824847 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:29.824867 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:21:29.825039 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:29.825043 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:29.825118 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:29.825201 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:21:29.825668 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.826363 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.827760 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.828217 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.828396 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:29.828886 (+ 490us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:21:29.829009 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:21:29.829112 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:29.829279 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 00:21:29.829372 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 00:21:29.833207 27128 raft_consensus.cc:1261] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940 [term 1 FOLLOWER]: Refusing update from remote peer bbed97135e09454083b90c16e90b7475: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:29.833245 27287 raft_consensus.cc:1261] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1 [term 1 FOLLOWER]: Refusing update from remote peer bbed97135e09454083b90c16e90b7475: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:29.833959 27629 consensus_queue.cc:1035] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2032db1dcec4456783180ee086ed6940" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:29.834262 27632 consensus_queue.cc:1035] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf032d1d952d46ceb0695d05b37e8ca1" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:29.836647 27626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.836122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.193:39527)
0812 00:21:29.836314 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.836442 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 00:21:29.839094 27624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.838597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.194:43851)
0812 00:21:29.838854 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.838950 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
I20260812 00:21:29.841876 27626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.841352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.193:60009)
0812 00:21:29.841669 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.841747 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186}
I20260812 00:21:29.842033 27630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.841493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.195:45583)
0812 00:21:29.841676 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.841774 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 00:21:29.848385 26759 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:21:29.848718 26759 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:21:29.855949 26759 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a10addcd04f8412b83702e3dd63daaf9: Sending DeleteTablet for 3 replicas of tablet 4f516a7792f947e7bd2c83e28ac812ca
I20260812 00:21:29.857954 27267 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f516a7792f947e7bd2c83e28ac812ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:29 UTC) from {username='oryx', principal='oryx/127.18.163.253@KRBTEST.COM'} at 127.0.0.1:42986
I20260812 00:21:29.858023 27107 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f516a7792f947e7bd2c83e28ac812ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:29 UTC) from {username='oryx', principal='oryx/127.18.163.253@KRBTEST.COM'} at 127.0.0.1:35856
I20260812 00:21:29.858927 27426 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f516a7792f947e7bd2c83e28ac812ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:29 UTC) from {username='oryx', principal='oryx/127.18.163.253@KRBTEST.COM'} at 127.0.0.1:60372
I20260812 00:21:29.860548 27630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.859585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.195:42935)
0812 00:21:29.860123 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.860281 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369}
I20260812 00:21:29.861191 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 26963
I20260812 00:21:29.865294 27624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.864631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.18.163.194:60967)
0812 00:21:29.864933 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:29.865046 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159}
I20260812 00:21:29.865784 27646 tablet_replica.cc:330] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940: stopping tablet replica
I20260812 00:21:29.866065 27646 raft_consensus.cc:2229] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:29.866470 27646 raft_consensus.cc:2258] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:29.868152 27646 ts_tablet_manager.cc:1905] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:29.874061 27645 tablet_replica.cc:330] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1: stopping tablet replica
I20260812 00:21:29.878039 27646 ts_tablet_manager.cc:1918] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:29.878216 27646 log.cc:1196] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/4f516a7792f947e7bd2c83e28ac812ca
I20260812 00:21:29.878690 27646 ts_tablet_manager.cc:1939] T 4f516a7792f947e7bd2c83e28ac812ca P 2032db1dcec4456783180ee086ed6940: Deleting consensus metadata
I20260812 00:21:29.879779 27645 raft_consensus.cc:2229] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:29.880012 26741 catalog_manager.cc:4841] TS 2032db1dcec4456783180ee086ed6940 (127.18.163.193:46795): tablet 4f516a7792f947e7bd2c83e28ac812ca (table test-table [id=ef2da893bc82469f90686e3b27008fc4]) successfully deleted
I20260812 00:21:29.881219 27645 raft_consensus.cc:2258] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:29.882434 27645 ts_tablet_manager.cc:1905] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:29.889618 27647 tablet_replica.cc:330] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475: stopping tablet replica
I20260812 00:21:29.889909 27647 raft_consensus.cc:2229] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:21:29.889883 27645 ts_tablet_manager.cc:1918] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:29.890134 27645 log.cc:1196] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/4f516a7792f947e7bd2c83e28ac812ca
I20260812 00:21:29.890679 27645 ts_tablet_manager.cc:1939] T 4f516a7792f947e7bd2c83e28ac812ca P cf032d1d952d46ceb0695d05b37e8ca1: Deleting consensus metadata
I20260812 00:21:29.891971 26740 catalog_manager.cc:4841] TS cf032d1d952d46ceb0695d05b37e8ca1 (127.18.163.194:43693): tablet 4f516a7792f947e7bd2c83e28ac812ca (table test-table [id=ef2da893bc82469f90686e3b27008fc4]) successfully deleted
I20260812 00:21:29.896039 27647 raft_consensus.cc:2258] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:29.897202 27647 ts_tablet_manager.cc:1905] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:29.905565 27647 ts_tablet_manager.cc:1918] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:29.905781 27647 log.cc:1196] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/4f516a7792f947e7bd2c83e28ac812ca
I20260812 00:21:29.906342 27647 ts_tablet_manager.cc:1939] T 4f516a7792f947e7bd2c83e28ac812ca P bbed97135e09454083b90c16e90b7475: Deleting consensus metadata
I20260812 00:21:29.906903 27613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:29.863241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35866 (local address 127.18.163.193:46795)
0812 00:21:29.863965 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:29.863973 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:29.886344 (+ 22371us) server_negotiation.cc:407] Connection header received
0812 00:21:29.886718 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:29.886728 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:29.886863 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:29.886946 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:29.890605 (+ 3659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.891743 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.893860 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:29.894554 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:29.894663 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:29.898967 (+ 4304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:29.898991 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:29.899014 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:29.899063 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:29.902929 (+ 3866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:29.904105 (+ 1176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:29.904114 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:29.904116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:29.904284 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:29.904742 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:29.904750 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:29.904758 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:29.905160 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:29.905514 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:29.906251 (+ 737us) server_negotiation.cc:299] Negotiation successful
0812 00:21:29.906524 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547}
I20260812 00:21:29.907632 26741 catalog_manager.cc:4841] TS bbed97135e09454083b90c16e90b7475 (127.18.163.195:46691): tablet 4f516a7792f947e7bd2c83e28ac812ca (table test-table [id=ef2da893bc82469f90686e3b27008fc4]) successfully deleted
I20260812 00:21:29.907689 27172 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:30.005999 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 26963
I20260812 00:21:30.030138 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 27190
I20260812 00:21:30.045727 27615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:30.031065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42994 (local address 127.18.163.194:43693)
0812 00:21:30.031305 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:30.031312 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:30.031334 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:21:30.031570 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:30.031574 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:30.031643 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:30.031759 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:30.033162 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:30.034243 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:30.035860 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:30.036322 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:30.036473 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:30.039324 (+ 2851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:30.039343 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:30.039361 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:30.039411 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:30.042524 (+ 3113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:30.043368 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:30.043378 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:30.043380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:30.043520 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:30.043952 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:30.043957 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:30.043962 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:30.044381 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:30.044729 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:30.045054 (+ 325us) server_negotiation.cc:299] Negotiation successful
0812 00:21:30.045308 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 00:21:30.046519 27336 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:30.108063 27596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:30.107487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.0.0.1:57898)
0812 00:21:30.107736 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:30.107856 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260812 00:21:30.109689 27596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:30.109191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35307 (local address 127.0.0.1:57906)
0812 00:21:30.109381 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:30.109479 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 00:21:30.145892 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 27190
I20260812 00:21:30.170334 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 27357
I20260812 00:21:30.185456 27612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:30.171236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60384 (local address 127.18.163.195:46691)
0812 00:21:30.171486 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:30.171490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:30.171548 (+ 58us) server_negotiation.cc:407] Connection header received
0812 00:21:30.171618 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:30.171622 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:30.171706 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:30.171791 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:30.173288 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:30.174294 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:30.175681 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:30.176090 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:30.176204 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:30.179136 (+ 2932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:30.179155 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:30.179172 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:30.179214 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:30.182317 (+ 3103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:30.183115 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:30.183133 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:30.183135 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:30.183287 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:30.183709 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:30.183714 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:30.183718 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:30.184143 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:30.184495 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:30.184858 (+ 363us) server_negotiation.cc:299] Negotiation successful
0812 00:21:30.185113 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 00:21:30.186190 27494 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:30.314404 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 27357
I20260812 00:21:30.344590 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 26603
I20260812 00:21:30.345821 26793 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:30.477216 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 26603
I20260812 00:21:30.509209 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 26714
I20260812 00:21:30.510486 27006 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:30.634696 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 26714
2026-08-12T00:21:30Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10602 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:21:30 dist-test-slave-njxd krb5kdc[27659](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:21:30 dist-test-slave-njxd krb5kdc[27659](info): set up 2 sockets
Aug 12 00:21:30 dist-test-slave-njxd krb5kdc[27659](info): commencing operation
krb5kdc: starting...
W20260812 00:21:31.850023 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:21:32 dist-test-slave-njxd krb5kdc[27659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:21:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:21:32Z Disabled control of system clock
WARNING: no policy specified for oryx/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.254.keytab.
Entry for principal oryx/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.254.keytab.
I20260812 00:21:32.169006 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:35039
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.254.keytab
--principal=oryx/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:43983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:35039
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:32.536870 27673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:32.537225 27673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:32.537328 27673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:32.545143 27673 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:21:32.545281 27673 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 00:21:32.545325 27673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:32.545382 27673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:32.545435 27673 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:21:32.545501 27673 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:21:32.556263 27673 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:43983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:35039
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.254.keytab
--principal=oryx/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:35039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:32.557754 27673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:32.559209 27673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:32.572518 27680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:32.572921 27682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:32.572570 27679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:32.573520 27673 server_base.cc:1034] running on GCE node
I20260812 00:21:32.574465 27673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:32.576112 27673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:32.577399 27673 hybrid_clock.cc:648] HybridClock initialized: now 1786494092577304 us; error 69 us; skew 500 ppm
I20260812 00:21:32.577847 27673 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:32 dist-test-slave-njxd krb5kdc[27659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494092, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:32.581524 27673 init.cc:377] Logged in from keytab as oryx/127.18.163.254@KRBTEST.COM (short username oryx)
I20260812 00:21:32.583264 27673 webserver.cc:460] Webserver started at http://127.18.163.254:37467/ using document root <none> and password file <none>
I20260812 00:21:32.584079 27673 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:32.584183 27673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:32.584479 27673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:32.587953 27673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "e91315169fd045ff9509947725de0e6c"
format_stamp: "Formatted at 2026-08-12 00:21:32 on dist-test-slave-njxd"
server_key: "4c726d868fcdd7e33d3b0bdec964c96a"
server_key_iv: "915ddc092e4991bfac84e9383d6fcf82"
server_key_version: "encryptionkey@0"
I20260812 00:21:32.589037 27673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "e91315169fd045ff9509947725de0e6c"
format_stamp: "Formatted at 2026-08-12 00:21:32 on dist-test-slave-njxd"
server_key: "4c726d868fcdd7e33d3b0bdec964c96a"
server_key_iv: "915ddc092e4991bfac84e9383d6fcf82"
server_key_version: "encryptionkey@0"
I20260812 00:21:32.596098 27673 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260812 00:21:32.600870 27690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:32.602955 27673 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:21:32.603230 27673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "e91315169fd045ff9509947725de0e6c"
format_stamp: "Formatted at 2026-08-12 00:21:32 on dist-test-slave-njxd"
server_key: "4c726d868fcdd7e33d3b0bdec964c96a"
server_key_iv: "915ddc092e4991bfac84e9383d6fcf82"
server_key_version: "encryptionkey@0"
I20260812 00:21:32.603520 27673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:32.635619 27673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:32.641078 27673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:32.641449 27673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:32.674801 27673 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:35039
I20260812 00:21:32.674858 27761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:35039 every 8 connection(s)
I20260812 00:21:32.676476 27673 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:21:32.681198 27762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:32.683966 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 27673
I20260812 00:21:32.684270 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:21:32.684983 19087 external_mini_cluster.cc:1428] Setting key 665847aca5e7fdc9171121f4e34ee340
I20260812 00:21:32.695403 27762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c: Bootstrap starting.
I20260812 00:21:32.700060 27762 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:32.701753 27762 log.cc:824] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c: Log is configured to *not* fsync() on all Append() calls
Aug 12 00:21:32 dist-test-slave-njxd krb5kdc[27659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM
I20260812 00:21:32.705528 27762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c: No bootstrap required, opened a new log
I20260812 00:21:32.712941 27765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:32.687618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56110 (local address 127.18.163.254:35039)
0812 00:21:32.688580 (+ 962us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:32.688596 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:32.688647 (+ 51us) server_negotiation.cc:407] Connection header received
0812 00:21:32.690634 (+ 1987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:32.690662 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:32.691213 (+ 551us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:32.691596 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:32.693766 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:32.695218 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:32.697119 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:32.698015 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:32.698190 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:32.703954 (+ 5764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:32.703964 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:32.703982 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:32.704024 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:32.707667 (+ 3643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:32.708661 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:32.708682 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:32.708691 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:32.708970 (+ 279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:32.709461 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:32.709467 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:32.709470 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:32.710225 (+ 755us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:32.710608 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:32.711170 (+ 562us) server_negotiation.cc:299] Negotiation successful
0812 00:21:32.711701 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":665,"thread_start_us":432,"threads_started":1}
I20260812 00:21:32.714996 27762 raft_consensus.cc:348] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e91315169fd045ff9509947725de0e6c" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35039 } }
I20260812 00:21:32.715433 27762 raft_consensus.cc:374] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:32.715565 27762 raft_consensus.cc:729] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e91315169fd045ff9509947725de0e6c, State: Initialized, Role: FOLLOWER
I20260812 00:21:32.716245 27762 consensus_queue.cc:260] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e91315169fd045ff9509947725de0e6c" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35039 } }
I20260812 00:21:32.716593 27762 raft_consensus.cc:388] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:21:32.716754 27762 raft_consensus.cc:482] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:21:32.716952 27762 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:32.719657 27762 raft_consensus.cc:504] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e91315169fd045ff9509947725de0e6c" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35039 } }
I20260812 00:21:32.720281 27762 leader_election.cc:302] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e91315169fd045ff9509947725de0e6c; no voters:
I20260812 00:21:32.721071 27762 leader_election.cc:288] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:21:32.721220 27767 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:32.722353 27767 raft_consensus.cc:686] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [term 1 LEADER]: Becoming Leader. State: Replica: e91315169fd045ff9509947725de0e6c, State: Running, Role: LEADER
I20260812 00:21:32.723001 27767 consensus_queue.cc:237] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e91315169fd045ff9509947725de0e6c" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35039 } }
I20260812 00:21:32.723600 27762 sys_catalog.cc:564] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:21:32.725994 27770 sys_catalog.cc:455] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e91315169fd045ff9509947725de0e6c. Latest consensus state: current_term: 1 leader_uuid: "e91315169fd045ff9509947725de0e6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e91315169fd045ff9509947725de0e6c" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35039 } } }
I20260812 00:21:32.726404 27770 sys_catalog.cc:458] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:32.726738 27768 sys_catalog.cc:455] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e91315169fd045ff9509947725de0e6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e91315169fd045ff9509947725de0e6c" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35039 } } }
I20260812 00:21:32.727298 27768 sys_catalog.cc:458] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:32.728080 27774 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:21:32.735373 27774 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:21:32.749090 27774 catalog_manager.cc:1347] Generated new cluster ID: c9fa6d4afcff48ba941c62a655b1a761
I20260812 00:21:32.749254 27774 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:21:32.779805 27774 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:21:32.781271 27774 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:21:32.789322 27774 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c: Generated new TSK 0
I20260812 00:21:32.790325 27774 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.193.keytab.
Entry for principal oryx/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.193.keytab.
I20260812 00:21:32.866418 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:35039
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.193.keytab
--principal=oryx/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:43983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:33.250067 27790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:33.250401 27790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:33.250504 27790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:33.258927 27790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:33.259073 27790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:33.259162 27790 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:21:33.259248 27790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:21:33.269646 27790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:43983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.193.keytab
--principal=oryx/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.163.254:35039
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:33.271029 27790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:33.272527 27790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:33.286773 27796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:33.286676 27797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:33.286733 27799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:33.287962 27790 server_base.cc:1034] running on GCE node
I20260812 00:21:33.288678 27790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:33.289856 27790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:33.291105 27790 hybrid_clock.cc:648] HybridClock initialized: now 1786494093291005 us; error 72 us; skew 500 ppm
I20260812 00:21:33.291385 27790 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:33 dist-test-slave-njxd krb5kdc[27659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494093, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:33.294862 27790 init.cc:377] Logged in from keytab as oryx/127.18.163.193@KRBTEST.COM (short username oryx)
I20260812 00:21:33.296403 27790 webserver.cc:460] Webserver started at http://127.18.163.193:45585/ using document root <none> and password file <none>
I20260812 00:21:33.297183 27790 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:33.297322 27790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:33.297762 27790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:33.300848 27790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "11bb111103664759baf9838aff300122"
format_stamp: "Formatted at 2026-08-12 00:21:33 on dist-test-slave-njxd"
server_key: "a1c8f1c9300d7d7f45f72ec6d0428733"
server_key_iv: "8b91f618415f02022697b0824dbb302d"
server_key_version: "encryptionkey@0"
I20260812 00:21:33.301810 27790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "11bb111103664759baf9838aff300122"
format_stamp: "Formatted at 2026-08-12 00:21:33 on dist-test-slave-njxd"
server_key: "a1c8f1c9300d7d7f45f72ec6d0428733"
server_key_iv: "8b91f618415f02022697b0824dbb302d"
server_key_version: "encryptionkey@0"
I20260812 00:21:33.307590 27790 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 00:21:33.311657 27806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:33.313264 27790 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:21:33.313477 27790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "11bb111103664759baf9838aff300122"
format_stamp: "Formatted at 2026-08-12 00:21:33 on dist-test-slave-njxd"
server_key: "a1c8f1c9300d7d7f45f72ec6d0428733"
server_key_iv: "8b91f618415f02022697b0824dbb302d"
server_key_version: "encryptionkey@0"
I20260812 00:21:33.313817 27790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:33.339994 27790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:33.345185 27790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:33.345502 27790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:33.348407 27790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:33.348543 27790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:33.348706 27790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:33.348779 27790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:21:33 dist-test-slave-njxd krb5kdc[27659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494093, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM
I20260812 00:21:33.374747 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:33.349330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:38293 (local address 127.18.163.254:35039)
0812 00:21:33.349835 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:33.349841 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:33.351316 (+ 1475us) server_negotiation.cc:407] Connection header received
0812 00:21:33.353734 (+ 2418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:33.353740 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:33.353847 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:33.353989 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:33.355633 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:33.357043 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:33.359889 (+ 2846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:33.360726 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:33.360900 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:33.366034 (+ 5134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:33.366043 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:33.366050 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:33.366109 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:33.369522 (+ 3413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:33.370860 (+ 1338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:33.370870 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:33.370876 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:33.371078 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:33.371821 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:33.371830 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:33.371837 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:33.372317 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:33.372516 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:33.373850 (+ 1334us) server_negotiation.cc:299] Negotiation successful
0812 00:21:33.374196 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":276,"threads_started":1}
I20260812 00:21:33.376618 27816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:33.350210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35039 (local address 127.18.163.193:38293)
0812 00:21:33.351119 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:33.351161 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:33.353318 (+ 2157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:33.354276 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:33.354285 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:33.354852 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:33.355431 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:33.355448 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:33.357319 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:33.357326 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:33.359672 (+ 2346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:33.359698 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:33.361030 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:33.361040 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:33.361368 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:33.362246 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:33.362273 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:33.365717 (+ 3444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:33.369766 (+ 4049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:33.369778 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:33.369795 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:33.370605 (+ 810us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:33.371213 (+ 608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:33.371219 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:33.371223 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:33.371619 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:33.372521 (+ 902us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:33.372532 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:33.373154 (+ 622us) client_negotiation.cc:769] Sending connection context
0812 00:21:33.373675 (+ 521us) client_negotiation.cc:240] Negotiation successful
0812 00:21:33.374492 (+ 817us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":404,"threads_started":1}
I20260812 00:21:33.400334 27790 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:42117
I20260812 00:21:33.400331 27941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:42117 every 8 connection(s)
I20260812 00:21:33.402266 27901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:33.384236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35039 (local address 127.18.163.193:41331)
0812 00:21:33.384878 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:33.384893 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:33.385076 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:33.385430 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:33.385435 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:33.386144 (+ 709us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:33.386697 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:33.386710 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:33.388545 (+ 1835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:33.388551 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:33.390317 (+ 1766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:33.390332 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:33.391516 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:33.391523 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:33.391738 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:33.392465 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:33.392501 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:33.394089 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:33.399052 (+ 4963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:33.399057 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:33.399061 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:33.399775 (+ 714us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:33.400326 (+ 551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:33.400330 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:33.400333 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:33.400635 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:33.401293 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:33.401297 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:33.401471 (+ 174us) client_negotiation.cc:769] Sending connection context
0812 00:21:33.401638 (+ 167us) client_negotiation.cc:240] Negotiation successful
0812 00:21:33.401931 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":361,"threads_started":1}
I20260812 00:21:33.402293 27790 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:21:33.402426 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:33.384121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:41331 (local address 127.18.163.254:35039)
0812 00:21:33.384309 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:33.384313 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:33.384994 (+ 681us) server_negotiation.cc:407] Connection header received
0812 00:21:33.385222 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:33.385226 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:33.385296 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:33.385400 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:33.386982 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:33.388327 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:33.390498 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:33.391250 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:33.391443 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:33.394432 (+ 2989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:33.394443 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:33.394452 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:33.394503 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:33.398857 (+ 4354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:33.399965 (+ 1108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:33.399974 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:33.399980 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:33.400175 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:33.400769 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:33.400774 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:33.400777 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:33.401164 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:33.401340 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:33.401774 (+ 434us) server_negotiation.cc:299] Negotiation successful
0812 00:21:33.402030 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 00:21:33.404920 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 27790
I20260812 00:21:33.405154 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:21:33.405958 19087 external_mini_cluster.cc:1428] Setting key 8be2dbe31a2757556fdd04ecfa68ad19
I20260812 00:21:33.404882 27942 heartbeater.cc:347] Connected to a master server at 127.18.163.254:35039
I20260812 00:21:33.406682 27942 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:33.407577 27942 heartbeater.cc:511] Master 127.18.163.254:35039 requested a full tablet report, sending...
I20260812 00:21:33.409845 27709 ts_manager.cc:194] Registered new tserver with Master: 11bb111103664759baf9838aff300122 (127.18.163.193:42117)
I20260812 00:21:33.411365 27709 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:38293
WARNING: no policy specified for oryx/127.18.163.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.163.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.194.keytab.
Entry for principal oryx/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.194.keytab.
I20260812 00:21:33.473606 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:35039
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.194.keytab
--principal=oryx/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:43983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:33.886307 27947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:33.886610 27947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:33.886802 27947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:33.894311 27947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:33.894430 27947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:33.894625 27947 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:21:33.894771 27947 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:21:33.905084 27947 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:43983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.194.keytab
--principal=oryx/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.163.254:35039
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:33.906594 27947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:33.908121 27947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:33.922806 27953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:33.923154 27955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:33.923079 27958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:33.924415 27947 server_base.cc:1034] running on GCE node
I20260812 00:21:33.925156 27947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:33.926348 27947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:33.927596 27947 hybrid_clock.cc:648] HybridClock initialized: now 1786494093927532 us; error 43 us; skew 500 ppm
I20260812 00:21:33.927951 27947 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:33 dist-test-slave-njxd krb5kdc[27659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494093, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:33.931496 27947 init.cc:377] Logged in from keytab as oryx/127.18.163.194@KRBTEST.COM (short username oryx)
I20260812 00:21:33.933200 27947 webserver.cc:460] Webserver started at http://127.18.163.194:35915/ using document root <none> and password file <none>
I20260812 00:21:33.934043 27947 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:33.934146 27947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:33.934437 27947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:33.937662 27947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "474a9db074c642db821008248f9bc770"
format_stamp: "Formatted at 2026-08-12 00:21:33 on dist-test-slave-njxd"
server_key: "df17a98e628d45875d2d01a5e5a07da3"
server_key_iv: "62df92781525df43772f5d2080db73a7"
server_key_version: "encryptionkey@0"
I20260812 00:21:33.938550 27947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "474a9db074c642db821008248f9bc770"
format_stamp: "Formatted at 2026-08-12 00:21:33 on dist-test-slave-njxd"
server_key: "df17a98e628d45875d2d01a5e5a07da3"
server_key_iv: "62df92781525df43772f5d2080db73a7"
server_key_version: "encryptionkey@0"
I20260812 00:21:33.944469 27947 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260812 00:21:33.948509 27965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:33.950114 27947 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:21:33.950321 27947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "474a9db074c642db821008248f9bc770"
format_stamp: "Formatted at 2026-08-12 00:21:33 on dist-test-slave-njxd"
server_key: "df17a98e628d45875d2d01a5e5a07da3"
server_key_iv: "62df92781525df43772f5d2080db73a7"
server_key_version: "encryptionkey@0"
I20260812 00:21:33.950584 27947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:33.985715 27947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:33.990355 27947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:33.990655 27947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:33.993625 27947 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:33.993755 27947 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:33.993940 27947 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:33.994037 27947 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:21:34 dist-test-slave-njxd krb5kdc[27659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494093, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM
I20260812 00:21:34.020650 27977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:33.994605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:60757 (local address 127.18.163.254:35039)
0812 00:21:33.995207 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:33.995213 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:33.996450 (+ 1237us) server_negotiation.cc:407] Connection header received
0812 00:21:33.998777 (+ 2327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:33.998783 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:33.998885 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:33.999038 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:34.001977 (+ 2939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.003399 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.006067 (+ 2668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.006526 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.006681 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.011897 (+ 5216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:34.011908 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:34.011913 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:34.011970 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:34.016312 (+ 4342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:34.017509 (+ 1197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:34.017516 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:34.017519 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:34.017759 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:34.018497 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:34.018505 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:34.018510 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:34.018871 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:34.019059 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:34.019941 (+ 882us) server_negotiation.cc:299] Negotiation successful
0812 00:21:34.020203 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":337,"threads_started":1}
I20260812 00:21:34.021929 27978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:33.995284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35039 (local address 127.18.163.194:60757)
0812 00:21:33.996240 (+ 956us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:33.996296 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:33.998356 (+ 2060us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:33.999509 (+ 1153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:33.999518 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:34.000534 (+ 1016us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:34.001634 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.001667 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.003623 (+ 1956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.003636 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.005877 (+ 2241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.005896 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.006802 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.006811 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.007039 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.007784 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:34.007809 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:34.011482 (+ 3673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:34.016529 (+ 5047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:34.016542 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:34.016566 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:34.017351 (+ 785us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:34.017895 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:34.017900 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:34.017905 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:34.018315 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:34.019027 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:34.019036 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:34.019549 (+ 513us) client_negotiation.cc:769] Sending connection context
0812 00:21:34.019837 (+ 288us) client_negotiation.cc:240] Negotiation successful
0812 00:21:34.020479 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":662,"thread_start_us":419,"threads_started":1}
I20260812 00:21:34.043869 27947 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:39333
I20260812 00:21:34.043941 28102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:39333 every 8 connection(s)
I20260812 00:21:34.045444 27947 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:21:34.048110 28103 heartbeater.cc:347] Connected to a master server at 127.18.163.254:35039
I20260812 00:21:34.048406 28103 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:34.048781 27977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.030701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:47523 (local address 127.18.163.254:35039)
0812 00:21:34.030960 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:34.030970 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:34.031549 (+ 579us) server_negotiation.cc:407] Connection header received
0812 00:21:34.031834 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:34.031843 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:34.031948 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:34.032060 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:34.033049 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.034275 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.036654 (+ 2379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.037462 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.037707 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.041149 (+ 3442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:34.041158 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:34.041164 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:34.041245 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:34.044982 (+ 3737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:34.046005 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:34.046014 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:34.046018 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:34.046220 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:34.046791 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:34.046796 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:34.046798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:34.047323 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:34.047499 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:34.048130 (+ 631us) server_negotiation.cc:299] Negotiation successful
0812 00:21:34.048403 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 00:21:34.048815 28073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.030683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35039 (local address 127.18.163.194:47523)
0812 00:21:34.031397 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:34.031427 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:34.031623 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:34.032118 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:34.032122 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:34.032580 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:34.032890 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.032900 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.034428 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.034432 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.036436 (+ 2004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.036462 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.037789 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.037797 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.038204 (+ 407us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.039149 (+ 945us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:34.039189 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:34.040824 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:34.045163 (+ 4339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:34.045169 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:34.045173 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:34.045854 (+ 681us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:34.046378 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:34.046386 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:34.046392 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:34.046625 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:34.047468 (+ 843us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:34.047476 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:34.047703 (+ 227us) client_negotiation.cc:769] Sending connection context
0812 00:21:34.047879 (+ 176us) client_negotiation.cc:240] Negotiation successful
0812 00:21:34.048283 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":377,"threads_started":1}
I20260812 00:21:34.049430 28103 heartbeater.cc:511] Master 127.18.163.254:35039 requested a full tablet report, sending...
I20260812 00:21:34.051066 27709 ts_manager.cc:194] Registered new tserver with Master: 474a9db074c642db821008248f9bc770 (127.18.163.194:39333)
I20260812 00:21:34.052218 27709 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:60757
I20260812 00:21:34.055480 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 27947
I20260812 00:21:34.055691 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:21:34.056145 19087 external_mini_cluster.cc:1428] Setting key f53d83a448a76fad77072b8fcf8a5789
WARNING: no policy specified for oryx/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.195.keytab.
Entry for principal oryx/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.195.keytab.
I20260812 00:21:34.120769 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:35039
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.195.keytab
--principal=oryx/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:43983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:21:34.414378 27942 heartbeater.cc:503] Master 127.18.163.254:35039 was elected leader, sending a full tablet report...
W20260812 00:21:34.490599 28109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:34.490933 28109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:34.491143 28109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:34.498972 28109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:34.499111 28109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:34.499256 28109 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:21:34.499423 28109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:21:34.510389 28109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:43983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.195.keytab
--principal=oryx/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.163.254:35039
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:34.511883 28109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:34.513353 28109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:34.528119 28118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:34.528152 28114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:34.528044 28116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:34.529105 28109 server_base.cc:1034] running on GCE node
I20260812 00:21:34.529861 28109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:34.530942 28109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:34.532244 28109 hybrid_clock.cc:648] HybridClock initialized: now 1786494094532117 us; error 120 us; skew 500 ppm
I20260812 00:21:34.532575 28109 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:34 dist-test-slave-njxd krb5kdc[27659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494094, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:34.535893 28109 init.cc:377] Logged in from keytab as oryx/127.18.163.195@KRBTEST.COM (short username oryx)
I20260812 00:21:34.537493 28109 webserver.cc:460] Webserver started at http://127.18.163.195:33717/ using document root <none> and password file <none>
I20260812 00:21:34.538316 28109 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:34.538470 28109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:34.538832 28109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:34.542289 28109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "3a991a46270e42ff8e822ed82c4317cd"
format_stamp: "Formatted at 2026-08-12 00:21:34 on dist-test-slave-njxd"
server_key: "c77d38696a198274f83088ba134e47a6"
server_key_iv: "ee4761224137d8326f7adafa6f748766"
server_key_version: "encryptionkey@0"
I20260812 00:21:34.543295 28109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "3a991a46270e42ff8e822ed82c4317cd"
format_stamp: "Formatted at 2026-08-12 00:21:34 on dist-test-slave-njxd"
server_key: "c77d38696a198274f83088ba134e47a6"
server_key_iv: "ee4761224137d8326f7adafa6f748766"
server_key_version: "encryptionkey@0"
I20260812 00:21:34.548979 28109 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 00:21:34.552876 28126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:34.554451 28109 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 00:21:34.554689 28109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "3a991a46270e42ff8e822ed82c4317cd"
format_stamp: "Formatted at 2026-08-12 00:21:34 on dist-test-slave-njxd"
server_key: "c77d38696a198274f83088ba134e47a6"
server_key_iv: "ee4761224137d8326f7adafa6f748766"
server_key_version: "encryptionkey@0"
I20260812 00:21:34.554908 28109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:34.571817 28109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:34.576207 28109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:34.576491 28109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:34.579824 28109 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:34.579967 28109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:34.580171 28109 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:34.580260 28109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:21:34 dist-test-slave-njxd krb5kdc[27659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494094, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM
I20260812 00:21:34.612586 28135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.580151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:43963 (local address 127.18.163.254:35039)
0812 00:21:34.580692 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:34.580701 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:34.582113 (+ 1412us) server_negotiation.cc:407] Connection header received
0812 00:21:34.584460 (+ 2347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:34.584467 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:34.584571 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:34.584720 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:34.587231 (+ 2511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.588639 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.591648 (+ 3009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.592105 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.592293 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.603503 (+ 11210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:34.603510 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:34.603513 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:34.603557 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:34.606955 (+ 3398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:34.608459 (+ 1504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:34.608466 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:34.608470 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:34.608687 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:34.609614 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:34.609623 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:34.609628 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:34.610123 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:34.610323 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:34.611637 (+ 1314us) server_negotiation.cc:299] Negotiation successful
0812 00:21:34.611979 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":289,"threads_started":1}
I20260812 00:21:34.614432 28137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.580939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35039 (local address 127.18.163.195:43963)
0812 00:21:34.581891 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:34.581933 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:34.584027 (+ 2094us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:34.585074 (+ 1047us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:34.585087 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:34.586029 (+ 942us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:34.586896 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.586916 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.588900 (+ 1984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.588909 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.591432 (+ 2523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.591451 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.592669 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.592681 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.593055 (+ 374us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.599407 (+ 6352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:34.599441 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:34.603143 (+ 3702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:34.607247 (+ 4104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:34.607262 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:34.607294 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:34.608239 (+ 945us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:34.608979 (+ 740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:34.608987 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:34.608993 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:34.609402 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:34.610323 (+ 921us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:34.610340 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:34.610996 (+ 656us) client_negotiation.cc:769] Sending connection context
0812 00:21:34.611441 (+ 445us) client_negotiation.cc:240] Negotiation successful
0812 00:21:34.612263 (+ 822us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":679,"thread_start_us":370,"threads_started":1}
I20260812 00:21:34.625813 28109 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:44761
I20260812 00:21:34.625873 28263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:44761 every 8 connection(s)
I20260812 00:21:34.627487 28109 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:21:34.630054 28264 heartbeater.cc:347] Connected to a master server at 127.18.163.254:35039
I20260812 00:21:34.630339 28264 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:34.631289 28264 heartbeater.cc:511] Master 127.18.163.254:35039 requested a full tablet report, sending...
I20260812 00:21:34.633153 27709 ts_manager.cc:194] Registered new tserver with Master: 3a991a46270e42ff8e822ed82c4317cd (127.18.163.195:44761)
I20260812 00:21:34.634043 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 28109
I20260812 00:21:34.634248 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:21:34.634413 27709 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:43963
I20260812 00:21:34.634853 19087 external_mini_cluster.cc:1428] Setting key ed5712434033a85ed21aa29039646d8c
I20260812 00:21:34.638623 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:21:34.639750 28135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.623452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:44849 (local address 127.18.163.254:35039)
0812 00:21:34.623787 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:34.623797 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:34.624292 (+ 495us) server_negotiation.cc:407] Connection header received
0812 00:21:34.624609 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:34.624616 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:34.624738 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:34.624882 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:34.626529 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.627674 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.630010 (+ 2336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.630614 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.630720 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.632972 (+ 2252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:34.632976 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:34.632980 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:34.633016 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:34.636517 (+ 3501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:34.637474 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:34.637485 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:34.637489 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:34.637759 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:34.638215 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:34.638221 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:34.638225 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:34.638538 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:34.638709 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:34.639119 (+ 410us) server_negotiation.cc:299] Negotiation successful
0812 00:21:34.639373 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260812 00:21:34.639820 28260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.623382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35039 (local address 127.18.163.195:44849)
0812 00:21:34.624138 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:34.624168 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:34.624381 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:34.624944 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:34.624950 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:34.625987 (+ 1037us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:34.626352 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.626364 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.627824 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.627828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.629849 (+ 2021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.629866 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.630826 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.630836 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.631033 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.631753 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:34.631774 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:34.632760 (+ 986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:34.636679 (+ 3919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:34.636686 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:34.636690 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:34.637316 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:34.637881 (+ 565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:34.637886 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:34.637890 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:34.638068 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:34.638666 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:34.638672 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:34.638860 (+ 188us) client_negotiation.cc:769] Sending connection context
0812 00:21:34.639018 (+ 158us) client_negotiation.cc:240] Negotiation successful
0812 00:21:34.639374 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":420,"threads_started":1}
Aug 12 00:21:34 dist-test-slave-njxd krb5kdc[27659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494094, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:21:34 dist-test-slave-njxd krb5kdc[27659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:34 dist-test-slave-njxd krb5kdc[27659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:21:34.714553 28135 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:34.702629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56112 (local address 127.18.163.254:35039)
0812 00:21:34.702894 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:34.702902 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:34.703242 (+ 340us) server_negotiation.cc:407] Connection header received
0812 00:21:34.703506 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:34.703511 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:34.703584 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:34.703705 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:34.705283 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.706118 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.707533 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.707984 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.708144 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.714291 (+ 6147us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56112: BlockingRecv error: recv got EOF from 127.0.0.1:56112 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 12 00:21:34 dist-test-slave-njxd krb5kdc[27659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494094, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM
I20260812 00:21:34.733261 28135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.718152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56122 (local address 127.18.163.254:35039)
0812 00:21:34.718371 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:34.718376 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:34.718883 (+ 507us) server_negotiation.cc:407] Connection header received
0812 00:21:34.719103 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:34.719107 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:34.719196 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:34.719323 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:34.720549 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.721578 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.723004 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.723424 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.723525 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.727881 (+ 4356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:34.727887 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:34.727890 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:34.727935 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:34.730804 (+ 2869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:34.731561 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:34.731565 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:34.731567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:34.731712 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:34.732058 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:34.732061 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:34.732063 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:34.732344 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:34.732542 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:34.732829 (+ 287us) server_negotiation.cc:299] Negotiation successful
0812 00:21:34.733021 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 00:21:34.737792 27709 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56122:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:21:34.745558 27709 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:21:34.782872 28290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.759824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49960 (local address 127.18.163.193:42117)
0812 00:21:34.771534 (+ 11710us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:34.771546 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:34.772630 (+ 1084us) server_negotiation.cc:407] Connection header received
0812 00:21:34.772753 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:34.772761 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:34.773066 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:34.774676 (+ 1610us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:34.774897 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.776258 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.780046 (+ 3788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.781679 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.781899 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.782074 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:34.782336 (+ 262us) server_negotiation.cc:299] Negotiation successful
0812 00:21:34.782524 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11492,"thread_start_us":11313,"threads_started":1}
I20260812 00:21:34.782985 28289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.759143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:42117 (local address 127.0.0.1:49960)
0812 00:21:34.772049 (+ 12906us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:34.772095 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:34.772352 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:34.773322 (+ 970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:34.773330 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:34.773362 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:34.774406 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.774427 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.776690 (+ 2263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.776698 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.779831 (+ 3133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.779847 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.781916 (+ 2069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.781922 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.782121 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.782157 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:21:34.782261 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 00:21:34.782503 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12623,"mutex_wait_us":221,"thread_start_us":13354,"threads_started":1}
I20260812 00:21:34.783058 28286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.759567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:39333 (local address 127.0.0.1:33498)
0812 00:21:34.772823 (+ 13256us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:34.772842 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:34.772969 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:34.773977 (+ 1008us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:34.773984 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:34.774011 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:34.774598 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.774613 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.776500 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.776508 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.779834 (+ 3326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.779846 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.782132 (+ 2286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.782138 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.782355 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.782386 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 00:21:34.782471 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 00:21:34.782610 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13092,"mutex_wait_us":224,"thread_start_us":14442,"threads_started":1}
I20260812 00:21:34.783185 28292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.760615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59800 (local address 127.18.163.195:44761)
0812 00:21:34.770960 (+ 10345us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:34.770973 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:34.774511 (+ 3538us) server_negotiation.cc:407] Connection header received
0812 00:21:34.774766 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:34.774775 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:34.775020 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:34.775234 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:34.775866 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.777505 (+ 1639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.779690 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.781325 (+ 1635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.781559 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.782549 (+ 990us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:34.782618 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 00:21:34.782826 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10100,"thread_start_us":9854,"threads_started":1}
I20260812 00:21:34.783916 28287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.759790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:44761 (local address 127.0.0.1:59800)
0812 00:21:34.774356 (+ 14566us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:34.774374 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:34.774575 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:34.775245 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:34.775250 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:34.775277 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:34.775631 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.775642 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.777739 (+ 2097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.777752 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.779501 (+ 1749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.779516 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.781752 (+ 2236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.781759 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.782006 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.782082 (+ 76us) client_negotiation.cc:769] Sending connection context
0812 00:21:34.782235 (+ 153us) client_negotiation.cc:240] Negotiation successful
0812 00:21:34.783529 (+ 1294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14417,"mutex_wait_us":1069,"thread_start_us":11798,"threads_started":1}
I20260812 00:21:34.783973 28291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.759832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33498 (local address 127.18.163.194:39333)
0812 00:21:34.769275 (+ 9443us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:34.769290 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:34.773128 (+ 3838us) server_negotiation.cc:407] Connection header received
0812 00:21:34.773250 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:34.773261 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:34.773510 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:34.773747 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:34.774807 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.776349 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.780024 (+ 3675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.781519 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.781749 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.781963 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:34.783460 (+ 1497us) server_negotiation.cc:299] Negotiation successful
0812 00:21:34.783669 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9227,"thread_start_us":9063,"threads_started":1}
I20260812 00:21:34.787606 28184 tablet_service.cc:1467] Processing CreateTablet for tablet b696028c372e49738d01ae914929ccb7 (DEFAULT_TABLE table=test-table [id=04e557ff62844e7faee66bf7d132db15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:34.787781 27867 tablet_service.cc:1467] Processing CreateTablet for tablet b696028c372e49738d01ae914929ccb7 (DEFAULT_TABLE table=test-table [id=04e557ff62844e7faee66bf7d132db15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:34.788072 28026 tablet_service.cc:1467] Processing CreateTablet for tablet b696028c372e49738d01ae914929ccb7 (DEFAULT_TABLE table=test-table [id=04e557ff62844e7faee66bf7d132db15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:34.789120 28184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b696028c372e49738d01ae914929ccb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:34.789322 27867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b696028c372e49738d01ae914929ccb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:34.789340 28026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b696028c372e49738d01ae914929ccb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:34.801884 28294 tablet_bootstrap.cc:492] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd: Bootstrap starting.
I20260812 00:21:34.805815 28294 tablet_bootstrap.cc:654] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:34.806282 28295 tablet_bootstrap.cc:492] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122: Bootstrap starting.
I20260812 00:21:34.807511 28294 log.cc:824] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:34.808147 28297 tablet_bootstrap.cc:492] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770: Bootstrap starting.
I20260812 00:21:34.811956 28295 tablet_bootstrap.cc:654] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:34.812641 28297 tablet_bootstrap.cc:654] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:34.813445 28295 log.cc:824] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:34.814025 28297 log.cc:824] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:34.815721 28294 tablet_bootstrap.cc:492] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd: No bootstrap required, opened a new log
I20260812 00:21:34.816123 28294 ts_tablet_manager.cc:1397] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.013s
I20260812 00:21:34.817796 28297 tablet_bootstrap.cc:492] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770: No bootstrap required, opened a new log
I20260812 00:21:34.818145 28297 ts_tablet_manager.cc:1397] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.005s
I20260812 00:21:34.818593 28295 tablet_bootstrap.cc:492] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122: No bootstrap required, opened a new log
I20260812 00:21:34.818904 28295 ts_tablet_manager.cc:1397] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.008s
I20260812 00:21:34.826396 28297 raft_consensus.cc:348] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:34.826841 28297 raft_consensus.cc:374] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:34.826992 28297 raft_consensus.cc:729] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 474a9db074c642db821008248f9bc770, State: Initialized, Role: FOLLOWER
I20260812 00:21:34.827685 28297 consensus_queue.cc:260] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:34.827934 28294 raft_consensus.cc:348] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:34.828451 28294 raft_consensus.cc:374] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:34.828595 28294 raft_consensus.cc:729] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a991a46270e42ff8e822ed82c4317cd, State: Initialized, Role: FOLLOWER
I20260812 00:21:34.828953 28103 heartbeater.cc:503] Master 127.18.163.254:35039 was elected leader, sending a full tablet report...
I20260812 00:21:34.829249 28294 consensus_queue.cc:260] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:34.830161 28295 raft_consensus.cc:348] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:34.830657 28295 raft_consensus.cc:374] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:34.830788 28295 raft_consensus.cc:729] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11bb111103664759baf9838aff300122, State: Initialized, Role: FOLLOWER
I20260812 00:21:34.831225 28297 ts_tablet_manager.cc:1428] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
I20260812 00:21:34.831228 28294 ts_tablet_manager.cc:1428] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260812 00:21:34.831467 28295 consensus_queue.cc:260] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:34.831843 28264 heartbeater.cc:503] Master 127.18.163.254:35039 was elected leader, sending a full tablet report...
I20260812 00:21:34.833405 28295 ts_tablet_manager.cc:1428] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122: Time spent starting tablet: real 0.014s user 0.012s sys 0.001s
I20260812 00:21:34.876924 28303 raft_consensus.cc:482] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:21:34.877314 28303 raft_consensus.cc:504] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:34.879223 28303 leader_election.cc:288] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 474a9db074c642db821008248f9bc770 (127.18.163.194:39333), 3a991a46270e42ff8e822ed82c4317cd (127.18.163.195:44761)
W20260812 00:21:34.879658 28265 tablet.cc:2369] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:21:34.887326 28292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.880450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:51577 (local address 127.18.163.195:44761)
0812 00:21:34.880670 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:34.880677 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:34.881380 (+ 703us) server_negotiation.cc:407] Connection header received
0812 00:21:34.881707 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:34.881711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:34.881773 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:34.881889 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:34.882595 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.883299 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.885454 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.886270 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.886484 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.886562 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:34.886888 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 00:21:34.887032 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 00:21:34.887337 28291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.879975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:54453 (local address 127.18.163.194:39333)
0812 00:21:34.880214 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:34.880222 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:34.881195 (+ 973us) server_negotiation.cc:407] Connection header received
0812 00:21:34.881641 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:34.881651 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:34.881745 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:34.881819 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:34.882510 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.883295 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.885376 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.886257 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.886439 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.886537 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:34.886888 (+ 351us) server_negotiation.cc:299] Negotiation successful
0812 00:21:34.887035 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:21:34.887524 28305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.879732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:39333 (local address 127.18.163.193:54453)
0812 00:21:34.881047 (+ 1315us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:34.881069 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:34.881322 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:34.881879 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:34.881883 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:34.881909 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:34.882343 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.882355 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.883451 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.883457 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.885190 (+ 1733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.885204 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.886513 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.886520 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.886693 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.886746 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 00:21:34.886856 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 00:21:34.887011 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1130,"mutex_wait_us":102,"thread_start_us":701,"threads_started":1}
I20260812 00:21:34.887547 28306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.880030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:44761 (local address 127.18.163.193:51577)
0812 00:21:34.881231 (+ 1201us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:34.881252 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:34.881522 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:34.881936 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:34.881941 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:34.881974 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:34.882389 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.882398 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.883464 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.883469 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.885256 (+ 1787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:34.885298 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.886555 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.886563 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:34.886697 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.886742 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 00:21:34.886856 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 00:21:34.887012 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1052,"mutex_wait_us":58,"thread_start_us":855,"threads_started":1}
I20260812 00:21:34.888918 28047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b696028c372e49738d01ae914929ccb7" candidate_uuid: "11bb111103664759baf9838aff300122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "474a9db074c642db821008248f9bc770" is_pre_election: true
I20260812 00:21:34.888918 28208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b696028c372e49738d01ae914929ccb7" candidate_uuid: "11bb111103664759baf9838aff300122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a991a46270e42ff8e822ed82c4317cd" is_pre_election: true
I20260812 00:21:34.889544 28047 raft_consensus.cc:2454] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11bb111103664759baf9838aff300122 in term 0.
I20260812 00:21:34.889544 28208 raft_consensus.cc:2454] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11bb111103664759baf9838aff300122 in term 0.
I20260812 00:21:34.890350 27808 leader_election.cc:302] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11bb111103664759baf9838aff300122, 474a9db074c642db821008248f9bc770; no voters:
I20260812 00:21:34.890796 28303 raft_consensus.cc:2781] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:21:34.890954 28303 raft_consensus.cc:482] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:21:34.891067 28303 raft_consensus.cc:3037] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:34.893390 28303 raft_consensus.cc:504] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:34.894213 28303 leader_election.cc:288] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [CANDIDATE]: Term 1 election: Requested vote from peers 474a9db074c642db821008248f9bc770 (127.18.163.194:39333), 3a991a46270e42ff8e822ed82c4317cd (127.18.163.195:44761)
I20260812 00:21:34.894747 28047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b696028c372e49738d01ae914929ccb7" candidate_uuid: "11bb111103664759baf9838aff300122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "474a9db074c642db821008248f9bc770"
I20260812 00:21:34.894851 28208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b696028c372e49738d01ae914929ccb7" candidate_uuid: "11bb111103664759baf9838aff300122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a991a46270e42ff8e822ed82c4317cd"
I20260812 00:21:34.894984 28047 raft_consensus.cc:3037] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:34.895133 28208 raft_consensus.cc:3037] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:34.897507 28047 raft_consensus.cc:2454] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11bb111103664759baf9838aff300122 in term 1.
I20260812 00:21:34.897517 28208 raft_consensus.cc:2454] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11bb111103664759baf9838aff300122 in term 1.
I20260812 00:21:34.898097 27807 leader_election.cc:302] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11bb111103664759baf9838aff300122, 3a991a46270e42ff8e822ed82c4317cd; no voters:
I20260812 00:21:34.898514 28303 raft_consensus.cc:2781] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:34.899096 28303 raft_consensus.cc:686] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [term 1 LEADER]: Becoming Leader. State: Replica: 11bb111103664759baf9838aff300122, State: Running, Role: LEADER
I20260812 00:21:34.899730 28303 consensus_queue.cc:237] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
W20260812 00:21:34.905877 27943 tablet.cc:2369] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:21:34.905226 27708 catalog_manager.cc:5495] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11bb111103664759baf9838aff300122 (127.18.163.193). New cstate: current_term: 1 leader_uuid: "11bb111103664759baf9838aff300122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } health_report { overall_health: UNKNOWN } } }
I20260812 00:21:34.942904 28290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:34.937105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49970 (local address 127.18.163.193:42117)
0812 00:21:34.937369 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:34.937377 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:34.937403 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:21:34.937665 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:34.937670 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:34.937766 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:34.937957 (+ 191us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:21:34.938356 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.939082 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.940506 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:34.940949 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:34.941096 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:34.941641 (+ 545us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:21:34.942257 (+ 616us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:21:34.942435 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:34.942519 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 00:21:34.942614 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:21:34.951710 28208 raft_consensus.cc:1261] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd [term 1 FOLLOWER]: Refusing update from remote peer 11bb111103664759baf9838aff300122: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:34.951732 28047 raft_consensus.cc:1261] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770 [term 1 FOLLOWER]: Refusing update from remote peer 11bb111103664759baf9838aff300122: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:34.952885 28307 consensus_queue.cc:1035] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:34.953269 28303 consensus_queue.cc:1035] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:34.967342 28310 mvcc.cc:205] Tried to move back new op lower bound from 7317479812911775744 to 7317479812713885696. Current Snapshot: MvccSnapshot[applied={T|T < 7317479812911775744}]
I20260812 00:21:34.986847 27709 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:21:34.987206 27709 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:21:34.991643 27709 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c: Sending DeleteTablet for 3 replicas of tablet b696028c372e49738d01ae914929ccb7
I20260812 00:21:34.993046 27867 tablet_service.cc:1514] Processing DeleteTablet for tablet b696028c372e49738d01ae914929ccb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:34 UTC) from {username='oryx', principal='oryx/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:49960
I20260812 00:21:34.993077 28026 tablet_service.cc:1514] Processing DeleteTablet for tablet b696028c372e49738d01ae914929ccb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:34 UTC) from {username='oryx', principal='oryx/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:33498
I20260812 00:21:34.993273 28184 tablet_service.cc:1514] Processing DeleteTablet for tablet b696028c372e49738d01ae914929ccb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:34 UTC) from {username='oryx', principal='oryx/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:59800
I20260812 00:21:34.995970 27709 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56122:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:21:34.997202 27709 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:21:35.009380 28025 tablet_service.cc:1467] Processing CreateTablet for tablet f59f5b82af444931bb6f6ef3241c155f (DEFAULT_TABLE table=test-table [id=c386910402214d78a0dd30877d0424a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:35.010324 28025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f59f5b82af444931bb6f6ef3241c155f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:35.014701 28322 tablet_replica.cc:330] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122: stopping tablet replica
I20260812 00:21:35.014906 28183 tablet_service.cc:1467] Processing CreateTablet for tablet f59f5b82af444931bb6f6ef3241c155f (DEFAULT_TABLE table=test-table [id=c386910402214d78a0dd30877d0424a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:35.014920 27866 tablet_service.cc:1467] Processing CreateTablet for tablet f59f5b82af444931bb6f6ef3241c155f (DEFAULT_TABLE table=test-table [id=c386910402214d78a0dd30877d0424a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:35.015579 28183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f59f5b82af444931bb6f6ef3241c155f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:35.015669 27866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f59f5b82af444931bb6f6ef3241c155f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:35.021986 28297 tablet_bootstrap.cc:492] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770: Bootstrap starting.
I20260812 00:21:35.024130 28324 tablet_replica.cc:330] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd: stopping tablet replica
I20260812 00:21:35.024353 28297 tablet_bootstrap.cc:654] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:35.024688 28324 raft_consensus.cc:2229] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:35.025378 28324 raft_consensus.cc:2258] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:35.026479 28295 tablet_bootstrap.cc:492] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122: Bootstrap starting.
I20260812 00:21:35.027237 28294 tablet_bootstrap.cc:492] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd: Bootstrap starting.
I20260812 00:21:35.028301 28295 tablet_bootstrap.cc:654] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:35.029408 28294 tablet_bootstrap.cc:654] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:35.029448 28297 tablet_bootstrap.cc:492] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770: No bootstrap required, opened a new log
I20260812 00:21:35.029645 28297 ts_tablet_manager.cc:1397] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.001s
I20260812 00:21:35.030350 28324 ts_tablet_manager.cc:1905] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:35.030548 28297 raft_consensus.cc:348] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.030828 28297 raft_consensus.cc:374] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:35.030961 28297 raft_consensus.cc:729] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 474a9db074c642db821008248f9bc770, State: Initialized, Role: FOLLOWER
I20260812 00:21:35.031281 28297 consensus_queue.cc:260] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.032780 28297 ts_tablet_manager.cc:1428] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:21:35.038093 28324 ts_tablet_manager.cc:1918] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:35.038369 28324 log.cc:1196] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/b696028c372e49738d01ae914929ccb7
I20260812 00:21:35.039016 28324 ts_tablet_manager.cc:1939] T b696028c372e49738d01ae914929ccb7 P 3a991a46270e42ff8e822ed82c4317cd: Deleting consensus metadata
I20260812 00:21:35.041237 27692 catalog_manager.cc:4841] TS 3a991a46270e42ff8e822ed82c4317cd (127.18.163.195:44761): tablet b696028c372e49738d01ae914929ccb7 (table test-table [id=04e557ff62844e7faee66bf7d132db15]) successfully deleted
I20260812 00:21:35.041407 28294 tablet_bootstrap.cc:492] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd: No bootstrap required, opened a new log
I20260812 00:21:35.041675 28294 ts_tablet_manager.cc:1397] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.001s
I20260812 00:21:35.015262 28322 raft_consensus.cc:2229] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:21:35.042594 28322 raft_consensus.cc:2258] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:35.043205 28294 raft_consensus.cc:348] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.043815 28323 tablet_replica.cc:330] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770: stopping tablet replica
I20260812 00:21:35.044010 28294 raft_consensus.cc:374] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:35.044173 28294 raft_consensus.cc:729] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a991a46270e42ff8e822ed82c4317cd, State: Initialized, Role: FOLLOWER
I20260812 00:21:35.044304 28323 raft_consensus.cc:2229] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:35.044646 28294 consensus_queue.cc:260] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.044808 28323 raft_consensus.cc:2258] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:35.045519 28294 ts_tablet_manager.cc:1428] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260812 00:21:35.047263 28323 ts_tablet_manager.cc:1905] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:35.048189 28322 ts_tablet_manager.cc:1905] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 00:21:35.048684 28104 tablet.cc:2369] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:21:35.054397 28295 tablet_bootstrap.cc:492] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122: No bootstrap required, opened a new log
I20260812 00:21:35.055941 28323 ts_tablet_manager.cc:1918] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:35.056162 28323 log.cc:1196] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/b696028c372e49738d01ae914929ccb7
I20260812 00:21:35.056265 28322 ts_tablet_manager.cc:1918] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:35.054736 28295 ts_tablet_manager.cc:1397] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.004s
I20260812 00:21:35.056504 28322 log.cc:1196] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/b696028c372e49738d01ae914929ccb7
I20260812 00:21:35.056737 28323 ts_tablet_manager.cc:1939] T b696028c372e49738d01ae914929ccb7 P 474a9db074c642db821008248f9bc770: Deleting consensus metadata
I20260812 00:21:35.057196 28322 ts_tablet_manager.cc:1939] T b696028c372e49738d01ae914929ccb7 P 11bb111103664759baf9838aff300122: Deleting consensus metadata
I20260812 00:21:35.057493 28295 raft_consensus.cc:348] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.057863 28295 raft_consensus.cc:374] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:35.058043 28295 raft_consensus.cc:729] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11bb111103664759baf9838aff300122, State: Initialized, Role: FOLLOWER
I20260812 00:21:35.058490 28295 consensus_queue.cc:260] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.059080 27693 catalog_manager.cc:4841] TS 474a9db074c642db821008248f9bc770 (127.18.163.194:39333): tablet b696028c372e49738d01ae914929ccb7 (table test-table [id=04e557ff62844e7faee66bf7d132db15]) successfully deleted
I20260812 00:21:35.059382 27695 catalog_manager.cc:4841] TS 11bb111103664759baf9838aff300122 (127.18.163.193:42117): tablet b696028c372e49738d01ae914929ccb7 (table test-table [id=04e557ff62844e7faee66bf7d132db15]) successfully deleted
I20260812 00:21:35.059943 28295 ts_tablet_manager.cc:1428] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:21:35.285925 28301 raft_consensus.cc:482] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:21:35.286186 28301 raft_consensus.cc:504] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.287859 28301 leader_election.cc:288] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11bb111103664759baf9838aff300122 (127.18.163.193:42117), 3a991a46270e42ff8e822ed82c4317cd (127.18.163.195:44761)
I20260812 00:21:35.296188 28292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.288676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:40175 (local address 127.18.163.195:44761)
0812 00:21:35.288872 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:35.288878 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:35.289740 (+ 862us) server_negotiation.cc:407] Connection header received
0812 00:21:35.289918 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:35.289925 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:35.290004 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:35.290103 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:35.290851 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.291955 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.294420 (+ 2465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.295192 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.295383 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.295473 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:35.295772 (+ 299us) server_negotiation.cc:299] Negotiation successful
0812 00:21:35.295908 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:21:35.296341 28328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.288231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:44761 (local address 127.18.163.194:40175)
0812 00:21:35.289608 (+ 1377us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:35.289628 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:35.289765 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:35.290184 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:35.290188 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:35.290216 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:35.290672 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:35.290685 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.292112 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.292117 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:35.294274 (+ 2157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:35.294284 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.295427 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.295434 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:35.295605 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.295631 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 00:21:35.295742 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 00:21:35.295885 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1215,"thread_start_us":635,"threads_started":1}
I20260812 00:21:35.297083 28290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.288390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:47693 (local address 127.18.163.193:42117)
0812 00:21:35.288646 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:35.288655 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:35.289354 (+ 699us) server_negotiation.cc:407] Connection header received
0812 00:21:35.289710 (+ 356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:35.289717 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:35.289860 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:35.289957 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:35.290718 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.291556 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.294249 (+ 2693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.295670 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.295850 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.295944 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:35.296589 (+ 645us) server_negotiation.cc:299] Negotiation successful
0812 00:21:35.296737 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 00:21:35.297122 28208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f59f5b82af444931bb6f6ef3241c155f" candidate_uuid: "474a9db074c642db821008248f9bc770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a991a46270e42ff8e822ed82c4317cd" is_pre_election: true
I20260812 00:21:35.297427 28208 raft_consensus.cc:2454] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 474a9db074c642db821008248f9bc770 in term 0.
I20260812 00:21:35.297891 28329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.288052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:42117 (local address 127.18.163.194:47693)
0812 00:21:35.289212 (+ 1160us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:35.289238 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:35.289487 (+ 249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:35.290002 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:35.290007 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:35.290035 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:35.290483 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:35.290497 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.291705 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.291712 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:35.294053 (+ 2341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:35.294069 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.296132 (+ 2063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.296138 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:35.296379 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.296415 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:21:35.297314 (+ 899us) client_negotiation.cc:240] Negotiation successful
0812 00:21:35.297475 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":972,"thread_start_us":1243,"threads_started":1}
I20260812 00:21:35.298008 27968 leader_election.cc:302] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a991a46270e42ff8e822ed82c4317cd, 474a9db074c642db821008248f9bc770; no voters:
I20260812 00:21:35.298501 28301 raft_consensus.cc:2781] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:21:35.298679 28301 raft_consensus.cc:482] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:21:35.298806 28301 raft_consensus.cc:3037] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:35.298913 27888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f59f5b82af444931bb6f6ef3241c155f" candidate_uuid: "474a9db074c642db821008248f9bc770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11bb111103664759baf9838aff300122" is_pre_election: true
I20260812 00:21:35.299391 27888 raft_consensus.cc:2454] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 474a9db074c642db821008248f9bc770 in term 0.
I20260812 00:21:35.301666 28301 raft_consensus.cc:504] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.302402 28301 leader_election.cc:288] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [CANDIDATE]: Term 1 election: Requested vote from peers 11bb111103664759baf9838aff300122 (127.18.163.193:42117), 3a991a46270e42ff8e822ed82c4317cd (127.18.163.195:44761)
I20260812 00:21:35.302887 27888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f59f5b82af444931bb6f6ef3241c155f" candidate_uuid: "474a9db074c642db821008248f9bc770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11bb111103664759baf9838aff300122"
I20260812 00:21:35.303148 27888 raft_consensus.cc:3037] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:35.303129 28208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f59f5b82af444931bb6f6ef3241c155f" candidate_uuid: "474a9db074c642db821008248f9bc770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a991a46270e42ff8e822ed82c4317cd"
I20260812 00:21:35.303366 28208 raft_consensus.cc:3037] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:35.306470 28208 raft_consensus.cc:2454] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 474a9db074c642db821008248f9bc770 in term 1.
I20260812 00:21:35.306754 27888 raft_consensus.cc:2454] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 474a9db074c642db821008248f9bc770 in term 1.
I20260812 00:21:35.307042 27968 leader_election.cc:302] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a991a46270e42ff8e822ed82c4317cd, 474a9db074c642db821008248f9bc770; no voters:
I20260812 00:21:35.307586 28301 raft_consensus.cc:2781] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:35.314620 28301 raft_consensus.cc:686] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [term 1 LEADER]: Becoming Leader. State: Replica: 474a9db074c642db821008248f9bc770, State: Running, Role: LEADER
I20260812 00:21:35.315398 28301 consensus_queue.cc:237] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.319834 27709 catalog_manager.cc:5495] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 474a9db074c642db821008248f9bc770 (127.18.163.194). New cstate: current_term: 1 leader_uuid: "474a9db074c642db821008248f9bc770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } health_report { overall_health: UNKNOWN } } }
Aug 12 00:21:35 dist-test-slave-njxd krb5kdc[27659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494092, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.254@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM
I20260812 00:21:35.385705 28338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.368200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:35039 (local address 127.0.0.1:56126)
0812 00:21:35.369287 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:35.369311 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:35.369493 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:35.369923 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:35.369929 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:35.370943 (+ 1014us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:35.371239 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:35.371255 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.372418 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.372425 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:35.374120 (+ 1695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:35.374140 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.375127 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.375134 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:35.375333 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.376336 (+ 1003us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:35.376365 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:35.379453 (+ 3088us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:35.382846 (+ 3393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:35.382864 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:35.382872 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:35.383352 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:35.383772 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:35.383778 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:35.383782 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:35.383924 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:35.384503 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:35.384513 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:35.384694 (+ 181us) client_negotiation.cc:769] Sending connection context
0812 00:21:35.384876 (+ 182us) client_negotiation.cc:240] Negotiation successful
0812 00:21:35.385221 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":904,"thread_start_us":696,"threads_started":1}
I20260812 00:21:35.385767 28337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.368267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56126 (local address 127.18.163.254:35039)
0812 00:21:35.369040 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:35.369047 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:35.369420 (+ 373us) server_negotiation.cc:407] Connection header received
0812 00:21:35.369677 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:35.369681 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:35.369744 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:35.369840 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:35.371433 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.372239 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.374449 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.374919 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.375033 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.379699 (+ 4666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:35.379704 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:35.379707 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:35.379769 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:35.382690 (+ 2921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:35.383497 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:35.383503 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:35.383508 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:35.383653 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:35.384047 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:35.384054 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:35.384057 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:35.384360 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:35.384529 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:35.384976 (+ 447us) server_negotiation.cc:299] Negotiation successful
0812 00:21:35.385361 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":170,"server-negotiator.queue_time_us":559,"thread_start_us":377,"threads_started":1}
I20260812 00:21:35.391454 27709 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:56126:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 00:21:35.392598 27709 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:21:35.401541 27866 tablet_service.cc:1467] Processing CreateTablet for tablet 376cf59b83dd4918b6de82cce9440e38 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=964de1c3769947d79b274e7617fb3277]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:21:35.402252 27866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 376cf59b83dd4918b6de82cce9440e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:35.404634 28026 tablet_service.cc:1467] Processing CreateTablet for tablet 376cf59b83dd4918b6de82cce9440e38 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=964de1c3769947d79b274e7617fb3277]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:21:35.405262 28026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 376cf59b83dd4918b6de82cce9440e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:35.406698 28183 tablet_service.cc:1467] Processing CreateTablet for tablet 376cf59b83dd4918b6de82cce9440e38 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=964de1c3769947d79b274e7617fb3277]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:21:35.407281 28183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 376cf59b83dd4918b6de82cce9440e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:35.413065 28295 tablet_bootstrap.cc:492] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122: Bootstrap starting.
I20260812 00:21:35.415489 28295 tablet_bootstrap.cc:654] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:35.422613 28294 tablet_bootstrap.cc:492] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd: Bootstrap starting.
I20260812 00:21:35.423115 28297 tablet_bootstrap.cc:492] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770: Bootstrap starting.
I20260812 00:21:35.424714 28294 tablet_bootstrap.cc:654] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:35.424844 28297 tablet_bootstrap.cc:654] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:35.435516 28295 tablet_bootstrap.cc:492] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122: No bootstrap required, opened a new log
I20260812 00:21:35.435642 28294 tablet_bootstrap.cc:492] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd: No bootstrap required, opened a new log
I20260812 00:21:35.435863 28294 ts_tablet_manager.cc:1397] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260812 00:21:35.435880 28295 ts_tablet_manager.cc:1397] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.003s
I20260812 00:21:35.436030 28297 tablet_bootstrap.cc:492] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770: No bootstrap required, opened a new log
I20260812 00:21:35.436218 28297 ts_tablet_manager.cc:1397] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.004s
I20260812 00:21:35.436780 28294 raft_consensus.cc:348] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.437057 28294 raft_consensus.cc:374] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:35.437141 28294 raft_consensus.cc:729] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a991a46270e42ff8e822ed82c4317cd, State: Initialized, Role: FOLLOWER
I20260812 00:21:35.437001 28297 raft_consensus.cc:348] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.437266 28297 raft_consensus.cc:374] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:35.437342 28297 raft_consensus.cc:729] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 474a9db074c642db821008248f9bc770, State: Initialized, Role: FOLLOWER
I20260812 00:21:35.437395 28294 consensus_queue.cc:260] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.437664 28297 consensus_queue.cc:260] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.437953 28302 tablet_replica.cc:439] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } } }
I20260812 00:21:35.438311 28302 tablet_replica.cc:442] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:21:35.438221 28301 tablet_replica.cc:439] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } } }
I20260812 00:21:35.438511 28301 tablet_replica.cc:442] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:21:35.438781 28294 ts_tablet_manager.cc:1428] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:21:35.439848 28297 ts_tablet_manager.cc:1428] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260812 00:21:35.440354 28302 raft_consensus.cc:482] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:21:35.440409 28295 raft_consensus.cc:348] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.440544 28302 raft_consensus.cc:504] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.440739 28295 raft_consensus.cc:374] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:35.440985 28295 raft_consensus.cc:729] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11bb111103664759baf9838aff300122, State: Initialized, Role: FOLLOWER
I20260812 00:21:35.441314 28295 consensus_queue.cc:260] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.442142 28295 ts_tablet_manager.cc:1428] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260812 00:21:35.442462 28302 leader_election.cc:288] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11bb111103664759baf9838aff300122 (127.18.163.193:42117), 474a9db074c642db821008248f9bc770 (127.18.163.194:39333)
I20260812 00:21:35.442873 28303 tablet_replica.cc:439] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } } }
I20260812 00:21:35.443198 28303 tablet_replica.cc:442] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:21:35.462935 28345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.444545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:48421 (local address 127.18.163.194:39333)
0812 00:21:35.454615 (+ 10070us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:35.454622 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:35.455542 (+ 920us) server_negotiation.cc:407] Connection header received
0812 00:21:35.455632 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:35.455638 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:35.455727 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:35.455881 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:35.456796 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.458120 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.460884 (+ 2764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.461881 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.462073 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.462157 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:35.462452 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 00:21:35.462606 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9858,"thread_start_us":10085,"threads_started":1}
I20260812 00:21:35.463047 28343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.443825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:39333 (local address 127.18.163.195:48421)
0812 00:21:35.455191 (+ 11366us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:35.455215 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:35.455394 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:35.456111 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:35.456117 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:35.456146 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:35.456580 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:35.456595 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.458311 (+ 1716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.458316 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:35.460652 (+ 2336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:35.460675 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.462078 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.462085 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:35.462274 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.462300 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 00:21:35.462419 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 00:21:35.462574 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11211,"mutex_wait_us":29,"thread_start_us":11050,"threads_started":1}
I20260812 00:21:35.463999 28290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.444914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:38869 (local address 127.18.163.193:42117)
0812 00:21:35.445330 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:35.445339 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:35.455893 (+ 10554us) server_negotiation.cc:407] Connection header received
0812 00:21:35.456206 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:35.456212 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:35.456298 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:35.456365 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:21:35.457219 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.458391 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.461105 (+ 2714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.462499 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.462672 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.462744 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:35.463496 (+ 752us) server_negotiation.cc:299] Negotiation successful
0812 00:21:35.463657 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211}
I20260812 00:21:35.463949 28047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "376cf59b83dd4918b6de82cce9440e38" candidate_uuid: "3a991a46270e42ff8e822ed82c4317cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "474a9db074c642db821008248f9bc770" is_pre_election: true
I20260812 00:21:35.464227 28047 raft_consensus.cc:2454] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a991a46270e42ff8e822ed82c4317cd in term 0.
I20260812 00:21:35.464735 28129 leader_election.cc:302] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a991a46270e42ff8e822ed82c4317cd, 474a9db074c642db821008248f9bc770; no voters:
I20260812 00:21:35.464913 28344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.444303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:42117 (local address 127.18.163.195:38869)
0812 00:21:35.455760 (+ 11457us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:35.455783 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:35.456013 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:35.456607 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:35.456611 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:35.456636 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:21:35.456979 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:35.456991 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.458617 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.458622 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:35.460907 (+ 2285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:35.460923 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.462917 (+ 1994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.462924 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:35.463155 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.463320 (+ 165us) client_negotiation.cc:769] Sending connection context
0812 00:21:35.464302 (+ 982us) client_negotiation.cc:240] Negotiation successful
0812 00:21:35.464475 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11308,"mutex_wait_us":60,"thread_start_us":11635,"threads_started":1}
I20260812 00:21:35.465214 28302 raft_consensus.cc:2781] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:21:35.465364 28302 raft_consensus.cc:482] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:21:35.465471 28302 raft_consensus.cc:3037] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:35.465809 27888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "376cf59b83dd4918b6de82cce9440e38" candidate_uuid: "3a991a46270e42ff8e822ed82c4317cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11bb111103664759baf9838aff300122" is_pre_election: true
I20260812 00:21:35.466136 27888 raft_consensus.cc:2454] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a991a46270e42ff8e822ed82c4317cd in term 0.
I20260812 00:21:35.468060 28302 raft_consensus.cc:504] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.468781 28302 leader_election.cc:288] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [CANDIDATE]: Term 1 election: Requested vote from peers 11bb111103664759baf9838aff300122 (127.18.163.193:42117), 474a9db074c642db821008248f9bc770 (127.18.163.194:39333)
I20260812 00:21:35.469283 27888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "376cf59b83dd4918b6de82cce9440e38" candidate_uuid: "3a991a46270e42ff8e822ed82c4317cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11bb111103664759baf9838aff300122"
I20260812 00:21:35.469345 28047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "376cf59b83dd4918b6de82cce9440e38" candidate_uuid: "3a991a46270e42ff8e822ed82c4317cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "474a9db074c642db821008248f9bc770"
I20260812 00:21:35.469602 28047 raft_consensus.cc:3037] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:35.469549 27888 raft_consensus.cc:3037] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:35.471889 27888 raft_consensus.cc:2454] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a991a46270e42ff8e822ed82c4317cd in term 1.
I20260812 00:21:35.472512 28131 leader_election.cc:302] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11bb111103664759baf9838aff300122, 3a991a46270e42ff8e822ed82c4317cd; no voters:
I20260812 00:21:35.472743 28047 raft_consensus.cc:2454] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a991a46270e42ff8e822ed82c4317cd in term 1.
I20260812 00:21:35.472894 28302 raft_consensus.cc:2781] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:35.473685 28302 raft_consensus.cc:686] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [term 1 LEADER]: Becoming Leader. State: Replica: 3a991a46270e42ff8e822ed82c4317cd, State: Running, Role: LEADER
I20260812 00:21:35.474131 28302 consensus_queue.cc:237] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.477145 28346 tablet_replica.cc:439] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd: TxnStatusTablet state changed. Reason: New leader 3a991a46270e42ff8e822ed82c4317cd. Latest consensus state: current_term: 1 leader_uuid: "3a991a46270e42ff8e822ed82c4317cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } } }
I20260812 00:21:35.477536 28346 tablet_replica.cc:442] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:21:35.479249 27709 catalog_manager.cc:5495] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a991a46270e42ff8e822ed82c4317cd (127.18.163.195). New cstate: current_term: 1 leader_uuid: "3a991a46270e42ff8e822ed82c4317cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } health_report { overall_health: HEALTHY } } }
I20260812 00:21:35.482053 28349 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 00:21:35.483337 28349 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 00:21:35.511456 28338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.504948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:44761 (local address 127.0.0.1:59810)
0812 00:21:35.505247 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:35.505272 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:35.505459 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:35.505997 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:35.506002 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:35.506014 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:21:35.506214 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:35.506223 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.507292 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.507298 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:35.508681 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:35.508700 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.509484 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.509490 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:35.509739 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.509807 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:21:35.510858 (+ 1051us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:21:35.510883 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 00:21:35.510972 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 00:21:35.511139 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 00:21:35.511480 28292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.504921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59810 (local address 127.18.163.195:44761)
0812 00:21:35.505148 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:35.505158 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:35.505365 (+ 207us) server_negotiation.cc:407] Connection header received
0812 00:21:35.505713 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:35.505717 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:35.505801 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:35.505972 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:21:35.506364 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.507149 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.508823 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.509304 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.509455 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.510018 (+ 563us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:21:35.510745 (+ 727us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:21:35.510911 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:35.510992 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 00:21:35.511120 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 00:21:35.516618 28047 raft_consensus.cc:1261] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770 [term 1 FOLLOWER]: Refusing update from remote peer 3a991a46270e42ff8e822ed82c4317cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:35.516867 27888 raft_consensus.cc:1261] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122 [term 1 FOLLOWER]: Refusing update from remote peer 3a991a46270e42ff8e822ed82c4317cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:35.517656 28302 consensus_queue.cc:1035] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:35.518057 28346 consensus_queue.cc:1035] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:35.523332 28301 tablet_replica.cc:439] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770: TxnStatusTablet state changed. Reason: New leader 3a991a46270e42ff8e822ed82c4317cd. Latest consensus state: current_term: 1 leader_uuid: "3a991a46270e42ff8e822ed82c4317cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } } }
I20260812 00:21:35.523773 28301 tablet_replica.cc:442] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:21:35.532445 28303 tablet_replica.cc:439] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122: TxnStatusTablet state changed. Reason: New leader 3a991a46270e42ff8e822ed82c4317cd. Latest consensus state: current_term: 1 leader_uuid: "3a991a46270e42ff8e822ed82c4317cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } } }
I20260812 00:21:35.532891 28303 tablet_replica.cc:442] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:21:35.534225 28346 tablet_replica.cc:439] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3a991a46270e42ff8e822ed82c4317cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } } }
I20260812 00:21:35.534567 28346 tablet_replica.cc:442] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:21:35.538313 28302 tablet_replica.cc:439] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3a991a46270e42ff8e822ed82c4317cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } } }
I20260812 00:21:35.538765 28302 tablet_replica.cc:442] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:21:35.543092 28303 tablet_replica.cc:439] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3a991a46270e42ff8e822ed82c4317cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } } }
I20260812 00:21:35.543452 28303 tablet_replica.cc:442] T 376cf59b83dd4918b6de82cce9440e38 P 11bb111103664759baf9838aff300122: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:21:35.545704 28301 tablet_replica.cc:439] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3a991a46270e42ff8e822ed82c4317cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } } }
I20260812 00:21:35.546025 28301 tablet_replica.cc:442] T 376cf59b83dd4918b6de82cce9440e38 P 474a9db074c642db821008248f9bc770: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:21:35.561254 28345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.549841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33504 (local address 127.18.163.194:39333)
0812 00:21:35.550065 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:35.550071 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:35.554371 (+ 4300us) server_negotiation.cc:407] Connection header received
0812 00:21:35.554658 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:35.554664 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:35.554784 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:35.554979 (+ 195us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:21:35.555510 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.556699 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.558258 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.558984 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.559241 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.559714 (+ 473us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:21:35.560538 (+ 824us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:21:35.560712 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:35.560839 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 00:21:35.560943 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 00:21:35.579015 28365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.572796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:44761 (local address 127.18.163.194:35777)
0812 00:21:35.573507 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:35.573523 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:35.573769 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:35.574150 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:35.574155 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:35.574168 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:21:35.574470 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:35.574479 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.575587 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.575600 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:35.576714 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:35.576727 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.577671 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.577679 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:35.577821 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.577892 (+ 71us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:21:35.578346 (+ 454us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:21:35.578361 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 00:21:35.578462 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 00:21:35.578623 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":391,"threads_started":1}
I20260812 00:21:35.579046 28292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.572827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:35777 (local address 127.18.163.195:44761)
0812 00:21:35.573037 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:35.573043 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:35.573717 (+ 674us) server_negotiation.cc:407] Connection header received
0812 00:21:35.573934 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:35.573938 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:35.574009 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:35.574117 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:21:35.574637 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.575427 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.576877 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.577414 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.577571 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.578105 (+ 534us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:21:35.578219 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:21:35.578332 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:35.578492 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 00:21:35.578583 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 00:21:35.589212 27888 raft_consensus.cc:1261] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122 [term 1 FOLLOWER]: Refusing update from remote peer 474a9db074c642db821008248f9bc770: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:35.589186 28208 raft_consensus.cc:1261] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd [term 1 FOLLOWER]: Refusing update from remote peer 474a9db074c642db821008248f9bc770: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:35.589998 28301 consensus_queue.cc:1035] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:35.590725 28301 consensus_queue.cc:1035] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:35.600993 28353 mvcc.cc:205] Tried to move back new op lower bound from 7317479815526084608 to 7317479814417047552. Current Snapshot: MvccSnapshot[applied={T|T < 7317479815526084608}]
I20260812 00:21:35.633687 28345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.624683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:46061 (local address 127.18.163.194:39333)
0812 00:21:35.624911 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:35.624918 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:35.625918 (+ 1000us) server_negotiation.cc:407] Connection header received
0812 00:21:35.626251 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:35.626258 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:35.626365 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:35.626429 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:21:35.627486 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.628700 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.631201 (+ 2501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.631912 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.632027 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.632776 (+ 749us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:21:35.632927 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:21:35.632995 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:35.633233 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 00:21:35.633327 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260812 00:21:35.634688 28371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.624883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:39333 (local address 127.18.163.195:46061)
0812 00:21:35.625805 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:35.625832 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:35.626053 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:35.626646 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:35.626651 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:35.626664 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:21:35.627275 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:35.627290 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.628903 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.628908 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:35.630981 (+ 2073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:35.631004 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.632257 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.632264 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:35.632464 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.632548 (+ 84us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:21:35.633078 (+ 530us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:21:35.633101 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 00:21:35.634004 (+ 903us) client_negotiation.cc:240] Negotiation successful
0812 00:21:35.634202 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"thread_start_us":430,"threads_started":1}
I20260812 00:21:35.695887 27709 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:21:35.696208 27709 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:21:35.700500 27709 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c: Sending DeleteTablet for 3 replicas of tablet f59f5b82af444931bb6f6ef3241c155f
I20260812 00:21:35.701905 28026 tablet_service.cc:1514] Processing DeleteTablet for tablet f59f5b82af444931bb6f6ef3241c155f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:35 UTC) from {username='oryx', principal='oryx/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:33498
I20260812 00:21:35.703095 27866 tablet_service.cc:1514] Processing DeleteTablet for tablet f59f5b82af444931bb6f6ef3241c155f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:35 UTC) from {username='oryx', principal='oryx/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:49960
I20260812 00:21:35.703667 28183 tablet_service.cc:1514] Processing DeleteTablet for tablet f59f5b82af444931bb6f6ef3241c155f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:35 UTC) from {username='oryx', principal='oryx/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:59800
I20260812 00:21:35.717681 28376 tablet_replica.cc:330] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd: stopping tablet replica
I20260812 00:21:35.718011 28376 raft_consensus.cc:2229] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:35.718355 28375 tablet_replica.cc:330] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122: stopping tablet replica
I20260812 00:21:35.718454 28376 raft_consensus.cc:2258] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:35.718593 28375 raft_consensus.cc:2229] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:35.718848 28375 raft_consensus.cc:2258] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:35.720067 28375 ts_tablet_manager.cc:1905] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:35.722963 28376 ts_tablet_manager.cc:1905] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:35.728981 28375 ts_tablet_manager.cc:1918] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:21:35.729161 28375 log.cc:1196] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/f59f5b82af444931bb6f6ef3241c155f
I20260812 00:21:35.729696 28375 ts_tablet_manager.cc:1939] T f59f5b82af444931bb6f6ef3241c155f P 11bb111103664759baf9838aff300122: Deleting consensus metadata
I20260812 00:21:35.731065 27695 catalog_manager.cc:4841] TS 11bb111103664759baf9838aff300122 (127.18.163.193:42117): tablet f59f5b82af444931bb6f6ef3241c155f (table test-table [id=c386910402214d78a0dd30877d0424a4]) successfully deleted
I20260812 00:21:35.731709 28374 tablet_replica.cc:330] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770: stopping tablet replica
I20260812 00:21:35.731945 28374 raft_consensus.cc:2229] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:21:35.732649 28374 raft_consensus.cc:2258] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:35.739523 28374 ts_tablet_manager.cc:1905] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:35.742597 28376 ts_tablet_manager.cc:1918] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:21:35.742933 28376 log.cc:1196] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/f59f5b82af444931bb6f6ef3241c155f
I20260812 00:21:35.743577 28376 ts_tablet_manager.cc:1939] T f59f5b82af444931bb6f6ef3241c155f P 3a991a46270e42ff8e822ed82c4317cd: Deleting consensus metadata
I20260812 00:21:35.745030 27692 catalog_manager.cc:4841] TS 3a991a46270e42ff8e822ed82c4317cd (127.18.163.195:44761): tablet f59f5b82af444931bb6f6ef3241c155f (table test-table [id=c386910402214d78a0dd30877d0424a4]) successfully deleted
I20260812 00:21:35.748034 28374 ts_tablet_manager.cc:1918] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:21:35.748203 28374 log.cc:1196] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/f59f5b82af444931bb6f6ef3241c155f
I20260812 00:21:35.748733 28374 ts_tablet_manager.cc:1939] T f59f5b82af444931bb6f6ef3241c155f P 474a9db074c642db821008248f9bc770: Deleting consensus metadata
I20260812 00:21:35.750228 27693 catalog_manager.cc:4841] TS 474a9db074c642db821008248f9bc770 (127.18.163.194:39333): tablet f59f5b82af444931bb6f6ef3241c155f (table test-table [id=c386910402214d78a0dd30877d0424a4]) successfully deleted
Aug 12 00:21:35 dist-test-slave-njxd krb5kdc[27659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:21:35 dist-test-slave-njxd krb5kdc[27659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:35 dist-test-slave-njxd krb5kdc[27659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:21:35.827497 28337 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:35.811885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56140 (local address 127.18.163.254:35039)
0812 00:21:35.812149 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:35.812157 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:35.812985 (+ 828us) server_negotiation.cc:407] Connection header received
0812 00:21:35.813195 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:35.813202 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:35.813309 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:35.813443 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:35.815575 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.816850 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.819368 (+ 2518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.820123 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.820297 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.827200 (+ 6903us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56140: BlockingRecv error: recv got EOF from 127.0.0.1:56140 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 12 00:21:35 dist-test-slave-njxd krb5kdc[27659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM
I20260812 00:21:35.858446 28337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:35.831813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56142 (local address 127.18.163.254:35039)
0812 00:21:35.832018 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:35.832024 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:35.838300 (+ 6276us) server_negotiation.cc:407] Connection header received
0812 00:21:35.838497 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:35.838504 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:35.838609 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:35.838748 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:35.840597 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.841893 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.844049 (+ 2156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:35.844753 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:35.844902 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:35.850547 (+ 5645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:35.850555 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:35.850562 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:35.850632 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:35.854508 (+ 3876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:35.855546 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:35.855552 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:35.855556 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:35.855752 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:35.856252 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:35.856257 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:35.856260 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:35.856647 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:35.856948 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:35.857341 (+ 393us) server_negotiation.cc:299] Negotiation successful
0812 00:21:35.858009 (+ 668us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 00:21:35.863219 27709 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56142:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:21:35.864017 27709 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:21:35.873107 28183 tablet_service.cc:1467] Processing CreateTablet for tablet 5ee6051e67aa4f608c1f5d543c871c67 (DEFAULT_TABLE table=test-table [id=d3beb785daa14209ae59a732104e081e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:35.873395 28026 tablet_service.cc:1467] Processing CreateTablet for tablet 5ee6051e67aa4f608c1f5d543c871c67 (DEFAULT_TABLE table=test-table [id=d3beb785daa14209ae59a732104e081e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:35.873759 28183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ee6051e67aa4f608c1f5d543c871c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:35.873939 28026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ee6051e67aa4f608c1f5d543c871c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:35.878118 27866 tablet_service.cc:1467] Processing CreateTablet for tablet 5ee6051e67aa4f608c1f5d543c871c67 (DEFAULT_TABLE table=test-table [id=d3beb785daa14209ae59a732104e081e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:35.878755 27866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ee6051e67aa4f608c1f5d543c871c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:35.881785 28294 tablet_bootstrap.cc:492] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd: Bootstrap starting.
I20260812 00:21:35.883845 28294 tablet_bootstrap.cc:654] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:35.893190 28295 tablet_bootstrap.cc:492] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122: Bootstrap starting.
I20260812 00:21:35.895275 28294 tablet_bootstrap.cc:492] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd: No bootstrap required, opened a new log
I20260812 00:21:35.895431 28295 tablet_bootstrap.cc:654] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:35.895481 28294 ts_tablet_manager.cc:1397] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.007s
I20260812 00:21:35.896386 28294 raft_consensus.cc:348] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.896688 28294 raft_consensus.cc:374] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:35.896800 28294 raft_consensus.cc:729] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a991a46270e42ff8e822ed82c4317cd, State: Initialized, Role: FOLLOWER
I20260812 00:21:35.897046 28294 consensus_queue.cc:260] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.897729 28294 ts_tablet_manager.cc:1428] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:21:35.902102 28297 tablet_bootstrap.cc:492] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770: Bootstrap starting.
I20260812 00:21:35.904325 28297 tablet_bootstrap.cc:654] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:35.907250 28297 tablet_bootstrap.cc:492] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770: No bootstrap required, opened a new log
I20260812 00:21:35.907516 28297 ts_tablet_manager.cc:1397] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260812 00:21:35.908592 28297 raft_consensus.cc:348] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.908934 28297 raft_consensus.cc:374] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:35.909119 28297 raft_consensus.cc:729] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 474a9db074c642db821008248f9bc770, State: Initialized, Role: FOLLOWER
I20260812 00:21:35.909380 28297 consensus_queue.cc:260] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.910754 28297 ts_tablet_manager.cc:1428] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260812 00:21:35.916121 28295 tablet_bootstrap.cc:492] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122: No bootstrap required, opened a new log
I20260812 00:21:35.916321 28295 ts_tablet_manager.cc:1397] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.005s
I20260812 00:21:35.917328 28295 raft_consensus.cc:348] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.917755 28295 raft_consensus.cc:374] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:35.917869 28295 raft_consensus.cc:729] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11bb111103664759baf9838aff300122, State: Initialized, Role: FOLLOWER
I20260812 00:21:35.918150 28295 consensus_queue.cc:260] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:35.918960 28295 ts_tablet_manager.cc:1428] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:21:36.221768 28359 raft_consensus.cc:482] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:21:36.222023 28359 raft_consensus.cc:504] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:36.222733 28359 leader_election.cc:288] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11bb111103664759baf9838aff300122 (127.18.163.193:42117), 474a9db074c642db821008248f9bc770 (127.18.163.194:39333)
I20260812 00:21:36.223455 28047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ee6051e67aa4f608c1f5d543c871c67" candidate_uuid: "3a991a46270e42ff8e822ed82c4317cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "474a9db074c642db821008248f9bc770" is_pre_election: true
I20260812 00:21:36.223452 27888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ee6051e67aa4f608c1f5d543c871c67" candidate_uuid: "3a991a46270e42ff8e822ed82c4317cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11bb111103664759baf9838aff300122" is_pre_election: true
I20260812 00:21:36.223744 28047 raft_consensus.cc:2454] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a991a46270e42ff8e822ed82c4317cd in term 0.
I20260812 00:21:36.223739 27888 raft_consensus.cc:2454] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a991a46270e42ff8e822ed82c4317cd in term 0.
I20260812 00:21:36.224236 28131 leader_election.cc:302] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11bb111103664759baf9838aff300122, 3a991a46270e42ff8e822ed82c4317cd; no voters:
I20260812 00:21:36.224606 28359 raft_consensus.cc:2781] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:21:36.224789 28359 raft_consensus.cc:482] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:21:36.224877 28359 raft_consensus.cc:3037] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:36.227638 28359 raft_consensus.cc:504] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:36.228315 28359 leader_election.cc:288] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [CANDIDATE]: Term 1 election: Requested vote from peers 11bb111103664759baf9838aff300122 (127.18.163.193:42117), 474a9db074c642db821008248f9bc770 (127.18.163.194:39333)
I20260812 00:21:36.228943 27888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ee6051e67aa4f608c1f5d543c871c67" candidate_uuid: "3a991a46270e42ff8e822ed82c4317cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11bb111103664759baf9838aff300122"
I20260812 00:21:36.228993 28047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ee6051e67aa4f608c1f5d543c871c67" candidate_uuid: "3a991a46270e42ff8e822ed82c4317cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "474a9db074c642db821008248f9bc770"
I20260812 00:21:36.229187 27888 raft_consensus.cc:3037] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:36.229216 28047 raft_consensus.cc:3037] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:36.231554 27888 raft_consensus.cc:2454] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a991a46270e42ff8e822ed82c4317cd in term 1.
I20260812 00:21:36.231587 28047 raft_consensus.cc:2454] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a991a46270e42ff8e822ed82c4317cd in term 1.
I20260812 00:21:36.232153 28131 leader_election.cc:302] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 11bb111103664759baf9838aff300122, 3a991a46270e42ff8e822ed82c4317cd, 474a9db074c642db821008248f9bc770; no voters:
I20260812 00:21:36.232508 28359 raft_consensus.cc:2781] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:36.232910 28359 raft_consensus.cc:686] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [term 1 LEADER]: Becoming Leader. State: Replica: 3a991a46270e42ff8e822ed82c4317cd, State: Running, Role: LEADER
I20260812 00:21:36.233222 28359 consensus_queue.cc:237] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:36.236225 27709 catalog_manager.cc:5495] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a991a46270e42ff8e822ed82c4317cd (127.18.163.195). New cstate: current_term: 1 leader_uuid: "3a991a46270e42ff8e822ed82c4317cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } health_report { overall_health: HEALTHY } } }
I20260812 00:21:36.287014 28398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:36.281998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59822 (local address 127.18.163.195:44761)
0812 00:21:36.282502 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:36.282507 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:36.282526 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:21:36.282594 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:36.282598 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:36.282664 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:36.282753 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:21:36.283149 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:36.283865 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:36.285213 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:36.285735 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:36.285845 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:36.286239 (+ 394us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:21:36.286348 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:21:36.286426 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:36.286561 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 00:21:36.286634 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":247,"threads_started":1}
I20260812 00:21:36.290719 27888 raft_consensus.cc:1261] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122 [term 1 FOLLOWER]: Refusing update from remote peer 3a991a46270e42ff8e822ed82c4317cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:36.290740 28047 raft_consensus.cc:1261] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770 [term 1 FOLLOWER]: Refusing update from remote peer 3a991a46270e42ff8e822ed82c4317cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:36.291524 28395 consensus_queue.cc:1035] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:36.291867 28359 consensus_queue.cc:1035] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:36.300678 28399 mvcc.cc:205] Tried to move back new op lower bound from 7317479818400706560 to 7317479818174373888. Current Snapshot: MvccSnapshot[applied={T|T < 7317479818400706560}]
I20260812 00:21:36.314031 27709 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:21:36.314320 27709 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:21:36.318035 27709 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c: Sending DeleteTablet for 3 replicas of tablet 5ee6051e67aa4f608c1f5d543c871c67
I20260812 00:21:36.319046 28026 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ee6051e67aa4f608c1f5d543c871c67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:36 UTC) from {username='oryx', principal='oryx/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:33498
I20260812 00:21:36.319433 28183 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ee6051e67aa4f608c1f5d543c871c67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:36 UTC) from {username='oryx', principal='oryx/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:59800
I20260812 00:21:36.319528 27866 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ee6051e67aa4f608c1f5d543c871c67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:36 UTC) from {username='oryx', principal='oryx/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:49960
I20260812 00:21:36.320739 27709 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56142:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:21:36.322070 27709 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:21:36.325477 28411 tablet_replica.cc:330] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd: stopping tablet replica
I20260812 00:21:36.325809 28411 raft_consensus.cc:2229] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:21:36.326640 28411 raft_consensus.cc:2258] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:36.328253 28411 ts_tablet_manager.cc:1905] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:36.329833 28412 tablet_replica.cc:330] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122: stopping tablet replica
I20260812 00:21:36.330130 28412 raft_consensus.cc:2229] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:36.330531 28412 raft_consensus.cc:2258] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:36.332304 28025 tablet_service.cc:1467] Processing CreateTablet for tablet 33c10efffa1848d1a1d03ff18b4629f1 (DEFAULT_TABLE table=test-table [id=ca35f1e430784aac90138ea9676d52c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:36.332437 28184 tablet_service.cc:1467] Processing CreateTablet for tablet 33c10efffa1848d1a1d03ff18b4629f1 (DEFAULT_TABLE table=test-table [id=ca35f1e430784aac90138ea9676d52c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:36.332823 28025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33c10efffa1848d1a1d03ff18b4629f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:36.333019 28184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33c10efffa1848d1a1d03ff18b4629f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:36.333391 27866 tablet_service.cc:1467] Processing CreateTablet for tablet 33c10efffa1848d1a1d03ff18b4629f1 (DEFAULT_TABLE table=test-table [id=ca35f1e430784aac90138ea9676d52c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:21:36.333926 27866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33c10efffa1848d1a1d03ff18b4629f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:21:36.341698 28295 tablet_bootstrap.cc:492] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122: Bootstrap starting.
I20260812 00:21:36.342514 28297 tablet_bootstrap.cc:492] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770: Bootstrap starting.
I20260812 00:21:36.343710 28295 tablet_bootstrap.cc:654] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:36.344494 28297 tablet_bootstrap.cc:654] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:36.352174 28410 tablet_replica.cc:330] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770: stopping tablet replica
I20260812 00:21:36.352483 28410 raft_consensus.cc:2229] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:36.352810 28410 raft_consensus.cc:2258] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:36.353840 28294 tablet_bootstrap.cc:492] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd: Bootstrap starting.
I20260812 00:21:36.354040 28295 tablet_bootstrap.cc:492] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122: No bootstrap required, opened a new log
I20260812 00:21:36.354051 28410 ts_tablet_manager.cc:1905] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:36.354302 28295 ts_tablet_manager.cc:1397] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20260812 00:21:36.355374 28295 raft_consensus.cc:348] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:36.355777 28294 tablet_bootstrap.cc:654] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:36.355926 28295 raft_consensus.cc:374] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:36.355978 28412 ts_tablet_manager.cc:1905] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:36.356139 28295 raft_consensus.cc:729] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11bb111103664759baf9838aff300122, State: Initialized, Role: FOLLOWER
I20260812 00:21:36.356537 28295 consensus_queue.cc:260] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:36.357316 28295 ts_tablet_manager.cc:1428] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:21:36.361845 28410 ts_tablet_manager.cc:1918] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:36.362032 28410 log.cc:1196] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/5ee6051e67aa4f608c1f5d543c871c67
I20260812 00:21:36.362594 28410 ts_tablet_manager.cc:1939] T 5ee6051e67aa4f608c1f5d543c871c67 P 474a9db074c642db821008248f9bc770: Deleting consensus metadata
I20260812 00:21:36.364044 27693 catalog_manager.cc:4841] TS 474a9db074c642db821008248f9bc770 (127.18.163.194:39333): tablet 5ee6051e67aa4f608c1f5d543c871c67 (table test-table [id=d3beb785daa14209ae59a732104e081e]) successfully deleted
I20260812 00:21:36.365226 28294 tablet_bootstrap.cc:492] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd: No bootstrap required, opened a new log
I20260812 00:21:36.365442 28294 ts_tablet_manager.cc:1397] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260812 00:21:36.366416 28294 raft_consensus.cc:348] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:36.366725 28294 raft_consensus.cc:374] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:36.366854 28294 raft_consensus.cc:729] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a991a46270e42ff8e822ed82c4317cd, State: Initialized, Role: FOLLOWER
I20260812 00:21:36.367175 28294 consensus_queue.cc:260] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:36.367878 28294 ts_tablet_manager.cc:1428] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:21:36.369892 28412 ts_tablet_manager.cc:1918] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:36.370069 28412 log.cc:1196] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/5ee6051e67aa4f608c1f5d543c871c67
I20260812 00:21:36.370615 28412 ts_tablet_manager.cc:1939] T 5ee6051e67aa4f608c1f5d543c871c67 P 11bb111103664759baf9838aff300122: Deleting consensus metadata
I20260812 00:21:36.371881 27695 catalog_manager.cc:4841] TS 11bb111103664759baf9838aff300122 (127.18.163.193:42117): tablet 5ee6051e67aa4f608c1f5d543c871c67 (table test-table [id=d3beb785daa14209ae59a732104e081e]) successfully deleted
I20260812 00:21:36.375898 28297 tablet_bootstrap.cc:492] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770: No bootstrap required, opened a new log
I20260812 00:21:36.376134 28297 ts_tablet_manager.cc:1397] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770: Time spent bootstrapping tablet: real 0.034s user 0.006s sys 0.003s
I20260812 00:21:36.376854 28297 raft_consensus.cc:348] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:36.377115 28297 raft_consensus.cc:374] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:36.377206 28297 raft_consensus.cc:729] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 474a9db074c642db821008248f9bc770, State: Initialized, Role: FOLLOWER
I20260812 00:21:36.377480 28297 consensus_queue.cc:260] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:36.377931 28411 ts_tablet_manager.cc:1918] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:21:36.378088 28411 log.cc:1196] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/5ee6051e67aa4f608c1f5d543c871c67
I20260812 00:21:36.378135 28297 ts_tablet_manager.cc:1428] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:21:36.379148 28411 ts_tablet_manager.cc:1939] T 5ee6051e67aa4f608c1f5d543c871c67 P 3a991a46270e42ff8e822ed82c4317cd: Deleting consensus metadata
I20260812 00:21:36.380573 27692 catalog_manager.cc:4841] TS 3a991a46270e42ff8e822ed82c4317cd (127.18.163.195:44761): tablet 5ee6051e67aa4f608c1f5d543c871c67 (table test-table [id=d3beb785daa14209ae59a732104e081e]) successfully deleted
I20260812 00:21:36.551035 28405 raft_consensus.cc:482] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:21:36.551306 28405 raft_consensus.cc:504] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:36.552203 28405 leader_election.cc:288] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11bb111103664759baf9838aff300122 (127.18.163.193:42117), 474a9db074c642db821008248f9bc770 (127.18.163.194:39333)
I20260812 00:21:36.552902 27888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33c10efffa1848d1a1d03ff18b4629f1" candidate_uuid: "3a991a46270e42ff8e822ed82c4317cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11bb111103664759baf9838aff300122" is_pre_election: true
I20260812 00:21:36.553021 28047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33c10efffa1848d1a1d03ff18b4629f1" candidate_uuid: "3a991a46270e42ff8e822ed82c4317cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "474a9db074c642db821008248f9bc770" is_pre_election: true
I20260812 00:21:36.553215 27888 raft_consensus.cc:2454] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a991a46270e42ff8e822ed82c4317cd in term 0.
I20260812 00:21:36.553282 28047 raft_consensus.cc:2454] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a991a46270e42ff8e822ed82c4317cd in term 0.
I20260812 00:21:36.553843 28131 leader_election.cc:302] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 11bb111103664759baf9838aff300122, 3a991a46270e42ff8e822ed82c4317cd, 474a9db074c642db821008248f9bc770; no voters:
I20260812 00:21:36.554239 28405 raft_consensus.cc:2781] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:21:36.554391 28405 raft_consensus.cc:482] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:21:36.554512 28405 raft_consensus.cc:3037] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:36.558266 28405 raft_consensus.cc:504] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:36.559126 28405 leader_election.cc:288] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [CANDIDATE]: Term 1 election: Requested vote from peers 11bb111103664759baf9838aff300122 (127.18.163.193:42117), 474a9db074c642db821008248f9bc770 (127.18.163.194:39333)
I20260812 00:21:36.559864 27888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33c10efffa1848d1a1d03ff18b4629f1" candidate_uuid: "3a991a46270e42ff8e822ed82c4317cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11bb111103664759baf9838aff300122"
I20260812 00:21:36.559854 28047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33c10efffa1848d1a1d03ff18b4629f1" candidate_uuid: "3a991a46270e42ff8e822ed82c4317cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "474a9db074c642db821008248f9bc770"
I20260812 00:21:36.560109 28047 raft_consensus.cc:3037] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:36.560137 27888 raft_consensus.cc:3037] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:36.562520 27888 raft_consensus.cc:2454] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a991a46270e42ff8e822ed82c4317cd in term 1.
I20260812 00:21:36.563169 28131 leader_election.cc:302] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11bb111103664759baf9838aff300122, 3a991a46270e42ff8e822ed82c4317cd; no voters:
I20260812 00:21:36.563500 28047 raft_consensus.cc:2454] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a991a46270e42ff8e822ed82c4317cd in term 1.
I20260812 00:21:36.563597 28405 raft_consensus.cc:2781] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:36.563832 28405 raft_consensus.cc:686] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [term 1 LEADER]: Becoming Leader. State: Replica: 3a991a46270e42ff8e822ed82c4317cd, State: Running, Role: LEADER
I20260812 00:21:36.564208 28405 consensus_queue.cc:237] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } }
I20260812 00:21:36.567611 27707 catalog_manager.cc:5495] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a991a46270e42ff8e822ed82c4317cd (127.18.163.195). New cstate: current_term: 1 leader_uuid: "3a991a46270e42ff8e822ed82c4317cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a991a46270e42ff8e822ed82c4317cd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44761 } health_report { overall_health: HEALTHY } } }
I20260812 00:21:36.630012 28398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:36.621879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:43093 (local address 127.18.163.195:44761)
0812 00:21:36.622112 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:36.622120 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:36.622897 (+ 777us) server_negotiation.cc:407] Connection header received
0812 00:21:36.623065 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:36.623071 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:36.623167 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:36.623312 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:21:36.624039 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:36.625312 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:36.627665 (+ 2353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:36.628377 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:36.628638 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:36.629087 (+ 449us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:21:36.629260 (+ 173us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:21:36.629377 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:36.629545 (+ 168us) server_negotiation.cc:299] Negotiation successful
0812 00:21:36.629682 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:21:36.630291 28421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:36.621870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:44761 (local address 127.18.163.195:43093)
0812 00:21:36.622757 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:36.622778 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:36.622930 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:36.623339 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:36.623342 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:36.623352 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:21:36.623785 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:36.623794 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:36.625468 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:36.625474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:36.627447 (+ 1973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:36.627485 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:36.628625 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:36.628632 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:36.628816 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:36.628876 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:21:36.629396 (+ 520us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:21:36.629408 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 00:21:36.629494 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 00:21:36.629713 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"mutex_wait_us":1,"thread_start_us":475,"threads_started":1}
I20260812 00:21:36.644516 27888 raft_consensus.cc:1261] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122 [term 1 FOLLOWER]: Refusing update from remote peer 3a991a46270e42ff8e822ed82c4317cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:36.644594 28047 raft_consensus.cc:1261] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770 [term 1 FOLLOWER]: Refusing update from remote peer 3a991a46270e42ff8e822ed82c4317cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:21:36.645251 28405 consensus_queue.cc:1035] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "11bb111103664759baf9838aff300122" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:36.645736 28395 consensus_queue.cc:1035] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "474a9db074c642db821008248f9bc770" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:21:36.744545 27707 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:21:36.744859 27707 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:21:36.748962 27707 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e91315169fd045ff9509947725de0e6c: Sending DeleteTablet for 3 replicas of tablet 33c10efffa1848d1a1d03ff18b4629f1
I20260812 00:21:36.750191 27866 tablet_service.cc:1514] Processing DeleteTablet for tablet 33c10efffa1848d1a1d03ff18b4629f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:36 UTC) from {username='oryx', principal='oryx/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:49960
I20260812 00:21:36.750221 28184 tablet_service.cc:1514] Processing DeleteTablet for tablet 33c10efffa1848d1a1d03ff18b4629f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:36 UTC) from {username='oryx', principal='oryx/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:59800
I20260812 00:21:36.750494 28025 tablet_service.cc:1514] Processing DeleteTablet for tablet 33c10efffa1848d1a1d03ff18b4629f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:21:36 UTC) from {username='oryx', principal='oryx/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:33498
I20260812 00:21:36.750571 28411 tablet_replica.cc:330] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd: stopping tablet replica
I20260812 00:21:36.750830 28410 tablet_replica.cc:330] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770: stopping tablet replica
I20260812 00:21:36.750816 28411 raft_consensus.cc:2229] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:21:36.751061 28410 raft_consensus.cc:2229] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:36.751187 28411 raft_consensus.cc:2258] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:36.751296 28410 raft_consensus.cc:2258] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:36.751507 28412 tablet_replica.cc:330] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122: stopping tablet replica
I20260812 00:21:36.751780 28412 raft_consensus.cc:2229] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:21:36.752024 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 27790
I20260812 00:21:36.752023 28412 raft_consensus.cc:2258] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:21:36.752959 28410 ts_tablet_manager.cc:1905] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:36.755884 28412 ts_tablet_manager.cc:1905] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:36.760174 28411 ts_tablet_manager.cc:1905] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:21:36.761508 28410 ts_tablet_manager.cc:1918] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:21:36.761813 28410 log.cc:1196] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/33c10efffa1848d1a1d03ff18b4629f1
I20260812 00:21:36.761977 28412 ts_tablet_manager.cc:1918] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:21:36.762183 28412 log.cc:1196] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/33c10efffa1848d1a1d03ff18b4629f1
I20260812 00:21:36.762465 28410 ts_tablet_manager.cc:1939] T 33c10efffa1848d1a1d03ff18b4629f1 P 474a9db074c642db821008248f9bc770: Deleting consensus metadata
I20260812 00:21:36.762645 28412 ts_tablet_manager.cc:1939] T 33c10efffa1848d1a1d03ff18b4629f1 P 11bb111103664759baf9838aff300122: Deleting consensus metadata
I20260812 00:21:36.763794 27693 catalog_manager.cc:4841] TS 474a9db074c642db821008248f9bc770 (127.18.163.194:39333): tablet 33c10efffa1848d1a1d03ff18b4629f1 (table test-table [id=ca35f1e430784aac90138ea9676d52c8]) successfully deleted
I20260812 00:21:36.770229 27695 catalog_manager.cc:4841] TS 11bb111103664759baf9838aff300122 (127.18.163.193:42117): tablet 33c10efffa1848d1a1d03ff18b4629f1 (table test-table [id=ca35f1e430784aac90138ea9676d52c8]) successfully deleted
I20260812 00:21:36.771354 28411 ts_tablet_manager.cc:1918] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:21:36.771559 28411 log.cc:1196] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/33c10efffa1848d1a1d03ff18b4629f1
I20260812 00:21:36.772131 28411 ts_tablet_manager.cc:1939] T 33c10efffa1848d1a1d03ff18b4629f1 P 3a991a46270e42ff8e822ed82c4317cd: Deleting consensus metadata
I20260812 00:21:36.773411 27692 catalog_manager.cc:4841] TS 3a991a46270e42ff8e822ed82c4317cd (127.18.163.195:44761): tablet 33c10efffa1848d1a1d03ff18b4629f1 (table test-table [id=ca35f1e430784aac90138ea9676d52c8]) successfully deleted
Aug 12 00:21:36 dist-test-slave-njxd krb5kdc[27659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.163.193@KRBTEST.COM
I20260812 00:21:36.789448 28428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:36.753843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49972 (local address 127.18.163.193:42117)
0812 00:21:36.770182 (+ 16339us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:36.770189 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:36.770220 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:21:36.770305 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:36.770311 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:36.770574 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:36.770736 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:36.772822 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:36.774060 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:36.775407 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:36.776077 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:36.776251 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:36.781061 (+ 4810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:36.781088 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:36.781112 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:36.781185 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:36.785996 (+ 4811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:36.786925 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:36.786937 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:36.786941 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:36.787155 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:36.787619 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:36.787625 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:36.787629 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:36.788174 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:36.788494 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:36.788755 (+ 261us) server_negotiation.cc:299] Negotiation successful
0812 00:21:36.789026 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16150,"thread_start_us":15987,"threads_started":1}
I20260812 00:21:36.790279 27937 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:36.925017 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 27790
I20260812 00:21:36.957172 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 27947
Aug 12 00:21:36 dist-test-slave-njxd krb5kdc[27659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.163.194@KRBTEST.COM
I20260812 00:21:36.973698 28430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:36.958047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33516 (local address 127.18.163.194:39333)
0812 00:21:36.958595 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:36.958600 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:36.958616 (+ 16us) server_negotiation.cc:407] Connection header received
0812 00:21:36.958675 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:36.958680 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:36.958742 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:36.958870 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:36.960365 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:36.961104 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:36.962597 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:36.963037 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:36.963189 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:36.967823 (+ 4634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:36.967844 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:36.967862 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:36.967912 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:36.970948 (+ 3036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:36.971731 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:36.971739 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:36.971742 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:36.971884 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:36.972220 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:36.972223 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:36.972225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:36.972613 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:36.972838 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:36.973113 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 00:21:36.973312 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":281,"threads_started":1}
I20260812 00:21:36.974406 28098 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:37.111246 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 27947
I20260812 00:21:37.133826 28434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:37.132931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:42117 (local address 127.18.163.195:50553)
0812 00:21:37.133429 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:37.133558 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:42117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":282,"threads_started":1}
W20260812 00:21:37.134174 28131 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.163.193:42117: connect: Connection refused (error 111)
I20260812 00:21:37.136204 28434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:37.135808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:42117 (local address 127.18.163.195:60875)
0812 00:21:37.135977 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:37.136074 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:42117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 00:21:37.136440 28131 consensus_peers.cc:487] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd -> Peer 11bb111103664759baf9838aff300122 (127.18.163.193:42117): Couldn't send request to peer 11bb111103664759baf9838aff300122. Status: Network error: Client connection negotiation failed: client connection to 127.18.163.193:42117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 00:21:37.143404 28129 connection.cc:535] client connection to 127.18.163.194:39333 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:21:37.144002 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 28109
I20260812 00:21:37.144860 28434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:37.144359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:39333 (local address 127.18.163.195:55099)
0812 00:21:37.144577 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:37.144661 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.194:39333: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 00:21:37.145170 28129 consensus_peers.cc:487] T 376cf59b83dd4918b6de82cce9440e38 P 3a991a46270e42ff8e822ed82c4317cd -> Peer 474a9db074c642db821008248f9bc770 (127.18.163.194:39333): Couldn't send request to peer 474a9db074c642db821008248f9bc770. Status: Network error: Client connection negotiation failed: client connection to 127.18.163.194:39333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
Aug 12 00:21:37 dist-test-slave-njxd krb5kdc[27659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.163.195@KRBTEST.COM
I20260812 00:21:37.161888 28436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:37.144920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59824 (local address 127.18.163.195:44761)
0812 00:21:37.145559 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:37.145566 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:37.145782 (+ 216us) server_negotiation.cc:407] Connection header received
0812 00:21:37.145840 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:37.145843 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:37.145906 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:37.145997 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:37.147381 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:37.148094 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:37.149416 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:37.149937 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:37.150048 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:37.154829 (+ 4781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:37.154850 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:37.154867 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:37.154922 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:37.158350 (+ 3428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:37.159262 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:37.159271 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:37.159273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:37.159455 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:37.160033 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:37.160039 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:37.160044 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:37.160493 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:37.160845 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:37.161215 (+ 370us) server_negotiation.cc:299] Negotiation successful
0812 00:21:37.161467 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":417,"threads_started":1}
I20260812 00:21:37.162654 28258 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:37.327517 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 28109
I20260812 00:21:37.363157 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 27673
I20260812 00:21:37.364562 27756 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:37.488544 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 27673
2026-08-12T00:21:37Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6851 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:21:37 dist-test-slave-njxd krb5kdc[28443](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:21:37 dist-test-slave-njxd krb5kdc[28443](info): set up 2 sockets
Aug 12 00:21:37 dist-test-slave-njxd krb5kdc[28443](info): commencing operation
krb5kdc: starting...
W20260812 00:21:38.712421 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.002s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:21:38 dist-test-slave-njxd krb5kdc[28443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:21:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:21:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:21:39.037448 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:39127
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:32865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:39127
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:39.398113 28456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:39.398588 28456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:39.398774 28456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:39.410806 28456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:21:39.410971 28456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:39.411082 28456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:39.411199 28456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:21:39.411278 28456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:21:39.427130 28456 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:32865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:39127
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:39127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:39.428872 28456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:39.431007 28456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:39.446695 28464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:39.446947 28463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:39.447085 28467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:39.448344 28456 server_base.cc:1034] running on GCE node
I20260812 00:21:39.449283 28456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:39.451056 28456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:39.452294 28456 hybrid_clock.cc:648] HybridClock initialized: now 1786494099452236 us; error 67 us; skew 500 ppm
I20260812 00:21:39.452704 28456 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T00:21:39Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2029 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:21:39 dist-test-slave-njxd krb5kdc[28473](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:21:39 dist-test-slave-njxd krb5kdc[28473](info): set up 2 sockets
Aug 12 00:21:39 dist-test-slave-njxd krb5kdc[28473](info): commencing operation
krb5kdc: starting...
W20260812 00:21:40.744267 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.001s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:21:40 dist-test-slave-njxd krb5kdc[28473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:21:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:21:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:21:41.075026 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:36995
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:33509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:36995
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:41.442024 28487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:41.442373 28487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:41.442556 28487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:41.450539 28487 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:21:41.450680 28487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:41.450773 28487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:41.450886 28487 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:21:41.450973 28487 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:21:41.461700 28487 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:33509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:36995
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:36995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:41.463272 28487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:41.464759 28487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:41.478065 28494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:41.478133 28495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:41.478004 28497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:41.479262 28487 server_base.cc:1034] running on GCE node
I20260812 00:21:41.480151 28487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:41.481863 28487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:41.483174 28487 hybrid_clock.cc:648] HybridClock initialized: now 1786494101483131 us; error 61 us; skew 500 ppm
I20260812 00:21:41.483623 28487 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:41 dist-test-slave-njxd krb5kdc[28473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494101, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:41.487452 28487 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:21:41.489356 28487 webserver.cc:460] Webserver started at http://127.18.163.254:34287/ using document root <none> and password file <none>
I20260812 00:21:41.490267 28487 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:41.490437 28487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:41.490800 28487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:41.494453 28487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "f959fae5c99e4b08b33efad5ec1c2130"
format_stamp: "Formatted at 2026-08-12 00:21:41 on dist-test-slave-njxd"
server_key: "900be36270b44a408d040a11047c5902"
server_key_iv: "2fc23dcb27f619427afc64a42475e344"
server_key_version: "encryptionkey@0"
I20260812 00:21:41.495391 28487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "f959fae5c99e4b08b33efad5ec1c2130"
format_stamp: "Formatted at 2026-08-12 00:21:41 on dist-test-slave-njxd"
server_key: "900be36270b44a408d040a11047c5902"
server_key_iv: "2fc23dcb27f619427afc64a42475e344"
server_key_version: "encryptionkey@0"
I20260812 00:21:41.501760 28487 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 00:21:41.505887 28506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:41.507668 28487 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 00:21:41.507915 28487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "f959fae5c99e4b08b33efad5ec1c2130"
format_stamp: "Formatted at 2026-08-12 00:21:41 on dist-test-slave-njxd"
server_key: "900be36270b44a408d040a11047c5902"
server_key_iv: "2fc23dcb27f619427afc64a42475e344"
server_key_version: "encryptionkey@0"
I20260812 00:21:41.508201 28487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:41.548573 28487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:41.553292 28487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:41.553700 28487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:41.574302 28487 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:36995
I20260812 00:21:41.574342 28565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:36995 every 8 connection(s)
I20260812 00:21:41.576107 28487 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:21:41.578923 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 28487
I20260812 00:21:41.579208 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:21:41.580113 19087 external_mini_cluster.cc:1428] Setting key ba21c9485a9e606aa72e203b2e567328
I20260812 00:21:41.581413 28566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 00:21:41 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:21:41.595528 28566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130: Bootstrap starting.
I20260812 00:21:41.599486 28566 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130: Neither blocks nor log segments found. Creating new log.
I20260812 00:21:41.600706 28566 log.cc:824] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:41.604274 28566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130: No bootstrap required, opened a new log
I20260812 00:21:41.604739 28569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:41.582546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52972 (local address 127.18.163.254:36995)
0812 00:21:41.583440 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:41.583454 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:41.583499 (+ 45us) server_negotiation.cc:407] Connection header received
0812 00:21:41.585233 (+ 1734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:41.585259 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:41.585829 (+ 570us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:41.586322 (+ 493us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:41.588003 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:41.589411 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:41.590845 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:41.591631 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:41.591885 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:41.596561 (+ 4676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:41.596570 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:41.596589 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:41.596635 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:41.600064 (+ 3429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:41.600937 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:41.600945 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:41.600952 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:41.601161 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:41.601636 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:41.601641 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:41.601643 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:41.602270 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:41.602617 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:41.603113 (+ 496us) server_negotiation.cc:299] Negotiation successful
0812 00:21:41.603582 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":400,"threads_started":1}
I20260812 00:21:41.613118 28566 raft_consensus.cc:348] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f959fae5c99e4b08b33efad5ec1c2130" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36995 } }
I20260812 00:21:41.613785 28566 raft_consensus.cc:374] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:21:41.613922 28566 raft_consensus.cc:729] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959fae5c99e4b08b33efad5ec1c2130, State: Initialized, Role: FOLLOWER
I20260812 00:21:41.614591 28566 consensus_queue.cc:260] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f959fae5c99e4b08b33efad5ec1c2130" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36995 } }
I20260812 00:21:41.614820 28566 raft_consensus.cc:388] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:21:41.614928 28566 raft_consensus.cc:482] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:21:41.615075 28566 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:21:41.617652 28566 raft_consensus.cc:504] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f959fae5c99e4b08b33efad5ec1c2130" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36995 } }
I20260812 00:21:41.618441 28566 leader_election.cc:302] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f959fae5c99e4b08b33efad5ec1c2130; no voters:
I20260812 00:21:41.619140 28566 leader_election.cc:288] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:21:41.619303 28571 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:21:41.620111 28571 raft_consensus.cc:686] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [term 1 LEADER]: Becoming Leader. State: Replica: f959fae5c99e4b08b33efad5ec1c2130, State: Running, Role: LEADER
I20260812 00:21:41.620699 28571 consensus_queue.cc:237] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f959fae5c99e4b08b33efad5ec1c2130" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36995 } }
I20260812 00:21:41.621549 28566 sys_catalog.cc:564] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:21:41.623934 28572 sys_catalog.cc:455] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f959fae5c99e4b08b33efad5ec1c2130" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f959fae5c99e4b08b33efad5ec1c2130" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36995 } } }
I20260812 00:21:41.624439 28572 sys_catalog.cc:458] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:41.624963 28573 sys_catalog.cc:455] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f959fae5c99e4b08b33efad5ec1c2130. Latest consensus state: current_term: 1 leader_uuid: "f959fae5c99e4b08b33efad5ec1c2130" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f959fae5c99e4b08b33efad5ec1c2130" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36995 } } }
I20260812 00:21:41.630879 28573 sys_catalog.cc:458] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:41.631978 28578 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:21:41.638162 28578 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:21:41.649843 28578 catalog_manager.cc:1347] Generated new cluster ID: 2258fd716f0144f0ae5d415e851771d7
I20260812 00:21:41.649999 28578 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:21:41.673466 28578 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:21:41.675637 28578 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:21:41.684087 28578 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130: Generated new TSK 0
I20260812 00:21:41.685194 28578 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:21:41.784997 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:36995
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:33509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:42.168649 28597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:42.169034 28597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:42.169216 28597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:42.177116 28597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:42.177315 28597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:42.177512 28597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:21:42.188110 28597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:33509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:36995
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:42.189670 28597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:42.191425 28597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:42.205914 28603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:42.205962 28604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:42.205986 28606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:42.206947 28597 server_base.cc:1034] running on GCE node
I20260812 00:21:42.207626 28597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:42.208707 28597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:42.209923 28597 hybrid_clock.cc:648] HybridClock initialized: now 1786494102209875 us; error 34 us; skew 500 ppm
I20260812 00:21:42.210291 28597 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:42 dist-test-slave-njxd krb5kdc[28473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494102, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:42.214066 28597 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:21:42.215787 28597 webserver.cc:460] Webserver started at http://127.18.163.193:41949/ using document root <none> and password file <none>
I20260812 00:21:42.216557 28597 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:42.216699 28597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:42.217064 28597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:42.220455 28597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "e2023205709f4d5a99a872a585fb0084"
format_stamp: "Formatted at 2026-08-12 00:21:42 on dist-test-slave-njxd"
server_key: "e992c9127050177a6f1efb6a60a2a09b"
server_key_iv: "e447f7638932ad20254c57b6a7c95149"
server_key_version: "encryptionkey@0"
I20260812 00:21:42.221349 28597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "e2023205709f4d5a99a872a585fb0084"
format_stamp: "Formatted at 2026-08-12 00:21:42 on dist-test-slave-njxd"
server_key: "e992c9127050177a6f1efb6a60a2a09b"
server_key_iv: "e447f7638932ad20254c57b6a7c95149"
server_key_version: "encryptionkey@0"
I20260812 00:21:42.227485 28597 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260812 00:21:42.231354 28614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:42.232882 28597 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:21:42.233068 28597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "e2023205709f4d5a99a872a585fb0084"
format_stamp: "Formatted at 2026-08-12 00:21:42 on dist-test-slave-njxd"
server_key: "e992c9127050177a6f1efb6a60a2a09b"
server_key_iv: "e447f7638932ad20254c57b6a7c95149"
server_key_version: "encryptionkey@0"
I20260812 00:21:42.233312 28597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:42.262288 28597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:42.266870 28597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:42.267220 28597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:42.268311 28597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:42.269884 28597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:42.270002 28597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:42.270167 28597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:42.270247 28597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:42.308872 28597 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:34639
I20260812 00:21:42.308943 28740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:34639 every 8 connection(s)
I20260812 00:21:42.310381 28597 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:21:42.320617 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 28597
I20260812 00:21:42.320878 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:21:42.321621 19087 external_mini_cluster.cc:1428] Setting key c3b8e3385a7a3d504534d1404a888ab1
Aug 12 00:21:42 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494102, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:21:42.336180 28744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:42.313942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:54741)
0812 00:21:42.314717 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:42.314763 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:42.316573 (+ 1810us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:42.317334 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:42.317344 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:42.318077 (+ 733us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:42.318713 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:42.318733 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:42.319826 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:42.319830 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:42.321320 (+ 1490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:42.321340 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:42.322557 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:42.322567 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:42.322852 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:42.323861 (+ 1009us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:42.323897 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:42.326992 (+ 3095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:42.330371 (+ 3379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:42.330385 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:42.330410 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:42.331195 (+ 785us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:42.331618 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:42.331625 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:42.331632 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:42.331951 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:42.332662 (+ 711us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:42.332674 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:42.333322 (+ 648us) client_negotiation.cc:769] Sending connection context
0812 00:21:42.333796 (+ 474us) client_negotiation.cc:240] Negotiation successful
0812 00:21:42.334478 (+ 682us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":294,"threads_started":1}
I20260812 00:21:42.338083 28743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:42.313172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:54741 (local address 127.18.163.254:36995)
0812 00:21:42.313740 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:42.313746 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:42.314903 (+ 1157us) server_negotiation.cc:407] Connection header received
0812 00:21:42.316895 (+ 1992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:42.316899 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:42.316976 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:42.317084 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:42.318908 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:42.319660 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:42.321510 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:42.322236 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:42.322385 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:42.327301 (+ 4916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:42.327307 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:42.327311 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:42.327350 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:42.330177 (+ 2827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:42.331349 (+ 1172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:42.331353 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:42.331356 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:42.331497 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:42.332084 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:42.332088 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:42.332090 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:42.332442 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:42.332607 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:42.337068 (+ 4461us) server_negotiation.cc:299] Negotiation successful
0812 00:21:42.337384 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":235,"threads_started":1}
I20260812 00:21:42.339598 28741 heartbeater.cc:347] Connected to a master server at 127.18.163.254:36995
I20260812 00:21:42.340050 28741 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:42.341223 28741 heartbeater.cc:511] Master 127.18.163.254:36995 requested a full tablet report, sending...
I20260812 00:21:42.345709 28526 ts_manager.cc:194] Registered new tserver with Master: e2023205709f4d5a99a872a585fb0084 (127.18.163.193:34639)
I20260812 00:21:42.348081 28526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:54741
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:21:42.397329 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:36995
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:33509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:42.773727 28747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:42.774078 28747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:42.774288 28747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:42.782434 28747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:42.782577 28747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:42.782775 28747 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:21:42.793468 28747 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:33509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:36995
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:42.795039 28747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:42.796555 28747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:42.811528 28755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:42.811681 28752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:42.811595 28753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:42.812824 28747 server_base.cc:1034] running on GCE node
I20260812 00:21:42.813683 28747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:42.814814 28747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:42.816043 28747 hybrid_clock.cc:648] HybridClock initialized: now 1786494102815988 us; error 43 us; skew 500 ppm
I20260812 00:21:42.816440 28747 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:42 dist-test-slave-njxd krb5kdc[28473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494102, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:42.820235 28747 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:21:42.822218 28747 webserver.cc:460] Webserver started at http://127.18.163.194:38429/ using document root <none> and password file <none>
I20260812 00:21:42.823133 28747 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:42.823300 28747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:42.823683 28747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:42.827108 28747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "b8916a01bb204c6b842f88c8534f4e26"
format_stamp: "Formatted at 2026-08-12 00:21:42 on dist-test-slave-njxd"
server_key: "fe9108c9773809d0a8d2a1afecffb580"
server_key_iv: "c64d84520765990d317d51dfd5218f9b"
server_key_version: "encryptionkey@0"
I20260812 00:21:42.828015 28747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "b8916a01bb204c6b842f88c8534f4e26"
format_stamp: "Formatted at 2026-08-12 00:21:42 on dist-test-slave-njxd"
server_key: "fe9108c9773809d0a8d2a1afecffb580"
server_key_iv: "c64d84520765990d317d51dfd5218f9b"
server_key_version: "encryptionkey@0"
I20260812 00:21:42.834980 28747 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260812 00:21:42.839186 28763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:42.840813 28747 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:21:42.841035 28747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "b8916a01bb204c6b842f88c8534f4e26"
format_stamp: "Formatted at 2026-08-12 00:21:42 on dist-test-slave-njxd"
server_key: "fe9108c9773809d0a8d2a1afecffb580"
server_key_iv: "c64d84520765990d317d51dfd5218f9b"
server_key_version: "encryptionkey@0"
I20260812 00:21:42.841300 28747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:42.858197 28747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:42.863107 28747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:42.863456 28747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:42.864548 28747 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:42.866160 28747 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:42.866283 28747 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:42.866448 28747 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:42.866540 28747 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:42.903682 28747 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:44851
I20260812 00:21:42.903731 28898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:44851 every 8 connection(s)
I20260812 00:21:42.905232 28747 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:21:42.911418 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 28747
I20260812 00:21:42.911650 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:21:42.912249 19087 external_mini_cluster.cc:1428] Setting key d4bb22e35d1223fa82f88b85c6d59faa
Aug 12 00:21:42 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494102, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:21:42.931455 28901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:42.908292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:57051 (local address 127.18.163.254:36995)
0812 00:21:42.908828 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:42.908835 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:42.910162 (+ 1327us) server_negotiation.cc:407] Connection header received
0812 00:21:42.912931 (+ 2769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:42.912935 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:42.913104 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:42.913253 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:42.915522 (+ 2269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:42.916760 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:42.918597 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:42.919363 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:42.919521 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:42.924229 (+ 4708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:42.924235 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:42.924239 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:42.924283 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:42.927186 (+ 2903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:42.928483 (+ 1297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:42.928492 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:42.928498 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:42.928696 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:42.929380 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:42.929384 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:42.929386 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:42.929798 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:42.929926 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:42.930964 (+ 1038us) server_negotiation.cc:299] Negotiation successful
0812 00:21:42.931171 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":247,"threads_started":1}
I20260812 00:21:42.933233 28902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:42.909049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:57051)
0812 00:21:42.909961 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:42.910009 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:42.912496 (+ 2487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:42.913624 (+ 1128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:42.913638 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:42.914571 (+ 933us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:42.915304 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:42.915324 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:42.916944 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:42.916948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:42.918403 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:42.918418 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:42.919611 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:42.919616 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:42.919854 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:42.920631 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:42.920656 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:42.923867 (+ 3211us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:42.927406 (+ 3539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:42.927420 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:42.927444 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:42.928255 (+ 811us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:42.928849 (+ 594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:42.928856 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:42.928861 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:42.929226 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:42.929947 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:42.929960 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:42.930514 (+ 554us) client_negotiation.cc:769] Sending connection context
0812 00:21:42.930858 (+ 344us) client_negotiation.cc:240] Negotiation successful
0812 00:21:42.931526 (+ 668us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":316,"threads_started":1}
I20260812 00:21:42.935250 28899 heartbeater.cc:347] Connected to a master server at 127.18.163.254:36995
I20260812 00:21:42.935636 28899 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:42.936691 28899 heartbeater.cc:511] Master 127.18.163.254:36995 requested a full tablet report, sending...
I20260812 00:21:42.938818 28526 ts_manager.cc:194] Registered new tserver with Master: b8916a01bb204c6b842f88c8534f4e26 (127.18.163.194:44851)
I20260812 00:21:42.940191 28526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:57051
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
I20260812 00:21:42.988390 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:36995
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:33509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:21:43.351825 28741 heartbeater.cc:503] Master 127.18.163.254:36995 was elected leader, sending a full tablet report...
W20260812 00:21:43.367846 28905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:43.368242 28905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:43.368427 28905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:43.376302 28905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:43.376495 28905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:43.376699 28905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:21:43.387300 28905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:33509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:36995
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:43.388820 28905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:43.390357 28905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:43.404924 28914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:43.405002 28912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:43.405002 28911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:43.405907 28905 server_base.cc:1034] running on GCE node
I20260812 00:21:43.406703 28905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:43.407896 28905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:43.409145 28905 hybrid_clock.cc:648] HybridClock initialized: now 1786494103409094 us; error 48 us; skew 500 ppm
I20260812 00:21:43.409508 28905 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:43 dist-test-slave-njxd krb5kdc[28473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494103, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:43.413106 28905 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:21:43.414764 28905 webserver.cc:460] Webserver started at http://127.18.163.195:45593/ using document root <none> and password file <none>
I20260812 00:21:43.415525 28905 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:43.415635 28905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:43.415925 28905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:21:43.419234 28905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "7cf290eadbc545aea2619a186b02e0bf"
format_stamp: "Formatted at 2026-08-12 00:21:43 on dist-test-slave-njxd"
server_key: "fa089a10158f025a63133576d5c4f2e4"
server_key_iv: "4c813118443decc37d833ff956c743a4"
server_key_version: "encryptionkey@0"
I20260812 00:21:43.420156 28905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "7cf290eadbc545aea2619a186b02e0bf"
format_stamp: "Formatted at 2026-08-12 00:21:43 on dist-test-slave-njxd"
server_key: "fa089a10158f025a63133576d5c4f2e4"
server_key_iv: "4c813118443decc37d833ff956c743a4"
server_key_version: "encryptionkey@0"
I20260812 00:21:43.426446 28905 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:21:43.430790 28922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:43.432466 28905 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260812 00:21:43.432639 28905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "7cf290eadbc545aea2619a186b02e0bf"
format_stamp: "Formatted at 2026-08-12 00:21:43 on dist-test-slave-njxd"
server_key: "fa089a10158f025a63133576d5c4f2e4"
server_key_iv: "4c813118443decc37d833ff956c743a4"
server_key_version: "encryptionkey@0"
I20260812 00:21:43.432857 28905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:43.453203 28905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:43.458086 28905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:43.458420 28905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:43.459513 28905 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:43.461058 28905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:43.461138 28905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:43.461326 28905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:43.461386 28905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:43.496829 28905 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:42393
I20260812 00:21:43.496882 29054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:42393 every 8 connection(s)
I20260812 00:21:43.498301 28905 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:21:43.502156 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 28905
I20260812 00:21:43.502421 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:21:43.502969 19087 external_mini_cluster.cc:1428] Setting key d022b03a3fa5287049391f5cffeed8ce
Aug 12 00:21:43 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494103, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:21:43.520756 29058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:43.501184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:50913 (local address 127.18.163.254:36995)
0812 00:21:43.501727 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:43.501732 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:43.502955 (+ 1223us) server_negotiation.cc:407] Connection header received
0812 00:21:43.505406 (+ 2451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:43.505412 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:43.505511 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:43.505669 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:43.507428 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:43.508217 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:43.509956 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:43.510394 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:43.510540 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:43.514461 (+ 3921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:43.514466 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:43.514470 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:43.514506 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:43.517075 (+ 2569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:43.518026 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:43.518033 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:43.518036 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:43.518204 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:43.518734 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:43.518738 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:43.518740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:43.519142 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:43.519334 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:43.520087 (+ 753us) server_negotiation.cc:299] Negotiation successful
0812 00:21:43.520342 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":259,"threads_started":1}
I20260812 00:21:43.521899 29059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:43.501841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:50913)
0812 00:21:43.502780 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:43.502820 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:43.505117 (+ 2297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:43.505931 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:43.505940 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:43.506599 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:43.507237 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:43.507257 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:43.508411 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:43.508416 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:43.509800 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:43.509814 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:43.510657 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:43.510664 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:43.510914 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:43.511617 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:43.511646 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:43.514235 (+ 2589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:21:43.517240 (+ 3005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:43.517248 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:43.517263 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:43.517879 (+ 616us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:43.518332 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:21:43.518337 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:21:43.518341 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:21:43.518571 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:21:43.519295 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:21:43.519303 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:21:43.519690 (+ 387us) client_negotiation.cc:769] Sending connection context
0812 00:21:43.519977 (+ 287us) client_negotiation.cc:240] Negotiation successful
0812 00:21:43.520578 (+ 601us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":390,"threads_started":1}
I20260812 00:21:43.523532 29055 heartbeater.cc:347] Connected to a master server at 127.18.163.254:36995
I20260812 00:21:43.523852 29055 heartbeater.cc:464] Registering TS with master...
I20260812 00:21:43.524590 29055 heartbeater.cc:511] Master 127.18.163.254:36995 requested a full tablet report, sending...
I20260812 00:21:43.526217 28526 ts_manager.cc:194] Registered new tserver with Master: 7cf290eadbc545aea2619a186b02e0bf (127.18.163.195:42393)
I20260812 00:21:43.527094 28526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:50913
I20260812 00:21:43.531783 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.193.keytab.
Entry for principal oryx/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.193.keytab.
WARNING: no policy specified for oryx/127.18.163.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.163.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.194.keytab.
Entry for principal oryx/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.194.keytab.
WARNING: no policy specified for oryx/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.195.keytab.
Entry for principal oryx/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.195.keytab.
I20260812 00:21:43.732584 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 28597
Aug 12 00:21:43 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:21:43.750849 29067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:43.734105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43620 (local address 127.18.163.193:34639)
0812 00:21:43.734937 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:43.734944 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:43.734972 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:21:43.735035 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:43.735042 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:43.735277 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:43.735420 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:43.737006 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:43.738372 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:43.739650 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:43.740248 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:43.740360 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:43.744750 (+ 4390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:43.744767 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:43.744783 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:43.744831 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:43.747923 (+ 3092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:43.748703 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:43.748711 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:43.748713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:43.748859 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:43.749210 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:43.749213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:43.749215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:43.749657 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:43.749934 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:43.750292 (+ 358us) server_negotiation.cc:299] Negotiation successful
0812 00:21:43.750514 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":485,"threads_started":1}
I20260812 00:21:43.752178 28736 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:43.838744 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 28597
I20260812 00:21:43.861730 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 28747
Aug 12 00:21:43 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
I20260812 00:21:43.878755 29070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:43.862733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42408 (local address 127.18.163.194:44851)
0812 00:21:43.863350 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:43.863358 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:43.863387 (+ 29us) server_negotiation.cc:407] Connection header received
0812 00:21:43.863452 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:43.863459 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:43.863703 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:43.863843 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:43.865089 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:43.866293 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:43.867552 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:43.868124 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:43.868228 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:43.872643 (+ 4415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:43.872658 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:43.872674 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:43.872715 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:43.875723 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:43.876431 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:43.876438 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:43.876441 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:43.876574 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:43.876929 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:43.876932 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:43.876934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:43.877298 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:43.877718 (+ 420us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:43.878044 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 00:21:43.878342 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":341,"threads_started":1}
I20260812 00:21:43.880136 28894 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:43.965446 28899 heartbeater.cc:503] Master 127.18.163.254:36995 was elected leader, sending a full tablet report...
I20260812 00:21:43.967080 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 28747
W20260812 00:21:43.989216 28510 connection.cc:535] server connection from 127.18.163.194:57051 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:21:43.989647 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 28905
Aug 12 00:21:43 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:21:44.006795 29072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:43.990596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60960 (local address 127.18.163.195:42393)
0812 00:21:43.991183 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:43.991191 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:43.991224 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:21:43.991299 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:43.991305 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:43.991529 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:43.991676 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:43.992977 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:43.994093 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:43.995411 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:43.995986 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:43.996091 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:44.000963 (+ 4872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:44.000978 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:44.000994 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:44.001036 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:44.004034 (+ 2998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:44.004817 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:44.004826 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:44.004828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:44.004967 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:44.005312 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:44.005315 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:44.005317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:44.005765 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:44.006023 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:44.006269 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 00:21:44.006483 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":268,"threads_started":1}
I20260812 00:21:44.008250 29050 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:44.097422 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 28905
I20260812 00:21:44.120508 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 28487
I20260812 00:21:44.121917 28561 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:21:44.232206 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 28487
I20260812 00:21:44.260190 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:36995
--webserver_interface=127.18.163.254
--webserver_port=34287
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:33509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:36995
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:21:44.633288 29075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:44.633713 29075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:44.633883 29075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:44.641474 29075 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:21:44.641719 29075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:44.641824 29075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:44.641937 29075 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:21:44.642026 29075 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:21:44.652520 29075 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:33509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:36995
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:36995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=34287
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:44.654129 29075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:44.655545 29075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:44.668993 29080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:44.668901 29081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:44.668923 29083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:44.669958 29075 server_base.cc:1034] running on GCE node
I20260812 00:21:44.670912 29075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:44.672605 29075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:44.673828 29075 hybrid_clock.cc:648] HybridClock initialized: now 1786494104673781 us; error 44 us; skew 500 ppm
I20260812 00:21:44.674237 29075 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:44 dist-test-slave-njxd krb5kdc[28473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494104, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:44.680990 29075 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:21:44.682901 29075 webserver.cc:460] Webserver started at http://127.18.163.254:34287/ using document root <none> and password file <none>
I20260812 00:21:44.683706 29075 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:44.683840 29075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:44.690203 29075 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 00:21:44.693622 29091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:44.695317 29075 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:21:44.695554 29075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "f959fae5c99e4b08b33efad5ec1c2130"
format_stamp: "Formatted at 2026-08-12 00:21:41 on dist-test-slave-njxd"
server_key: "900be36270b44a408d040a11047c5902"
server_key_iv: "2fc23dcb27f619427afc64a42475e344"
server_key_version: "encryptionkey@0"
I20260812 00:21:44.696655 29075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:44.711146 29075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:44.715801 29075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:44.716125 29075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:44.737816 29075 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:36995
I20260812 00:21:44.737836 29149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:36995 every 8 connection(s)
I20260812 00:21:44.739560 29075 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:21:44.745393 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 29075
I20260812 00:21:44.746506 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:34639
--local_ip_for_outbound_sockets=127.18.163.193
--tserver_master_addrs=127.18.163.254:36995
--webserver_port=41949
--webserver_interface=127.18.163.193
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:33509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.18.163.193
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.193.keytab with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:21:44.748200 29150 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:21:44.754129 29150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130: Bootstrap starting.
I20260812 00:21:44.777223 29150 log.cc:824] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130: Log is configured to *not* fsync() on all Append() calls
I20260812 00:21:44.787779 29150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:21:44.788431 29150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130: Bootstrap complete.
I20260812 00:21:44.798514 29150 raft_consensus.cc:348] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f959fae5c99e4b08b33efad5ec1c2130" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36995 } }
I20260812 00:21:44.799432 29150 raft_consensus.cc:729] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959fae5c99e4b08b33efad5ec1c2130, State: Initialized, Role: FOLLOWER
I20260812 00:21:44.800232 29150 consensus_queue.cc:260] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f959fae5c99e4b08b33efad5ec1c2130" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36995 } }
I20260812 00:21:44.800554 29150 raft_consensus.cc:388] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:21:44.800734 29150 raft_consensus.cc:482] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:21:44.800947 29150 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:21:44.805425 29150 raft_consensus.cc:504] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f959fae5c99e4b08b33efad5ec1c2130" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36995 } }
I20260812 00:21:44.806144 29150 leader_election.cc:302] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f959fae5c99e4b08b33efad5ec1c2130; no voters:
I20260812 00:21:44.806917 29150 leader_election.cc:288] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:21:44.807076 29154 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:21:44.808444 29154 raft_consensus.cc:686] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [term 2 LEADER]: Becoming Leader. State: Replica: f959fae5c99e4b08b33efad5ec1c2130, State: Running, Role: LEADER
I20260812 00:21:44.809149 29154 consensus_queue.cc:237] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f959fae5c99e4b08b33efad5ec1c2130" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36995 } }
I20260812 00:21:44.809612 29150 sys_catalog.cc:564] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:21:44.812623 29155 sys_catalog.cc:455] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f959fae5c99e4b08b33efad5ec1c2130" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f959fae5c99e4b08b33efad5ec1c2130" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36995 } } }
I20260812 00:21:44.813330 29155 sys_catalog.cc:458] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:44.812610 29156 sys_catalog.cc:455] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f959fae5c99e4b08b33efad5ec1c2130. Latest consensus state: current_term: 2 leader_uuid: "f959fae5c99e4b08b33efad5ec1c2130" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f959fae5c99e4b08b33efad5ec1c2130" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36995 } } }
I20260812 00:21:44.813768 29156 sys_catalog.cc:458] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130 [sys.catalog]: This master's current role is: LEADER
I20260812 00:21:44.828293 29162 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:21:44.836372 29162 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:21:44.839248 29162 catalog_manager.cc:1259] Loaded cluster ID: 2258fd716f0144f0ae5d415e851771d7
I20260812 00:21:44.839409 29162 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:21:44.845113 29162 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:21:44.847450 29162 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f959fae5c99e4b08b33efad5ec1c2130: Loaded TSK: 0
I20260812 00:21:44.849864 29162 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:21:45.165829 29152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:45.166167 29152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:45.166329 29152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:45.174376 29152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:45.174512 29152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:45.174716 29152 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:21:45.185271 29152 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:33509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.193.keytab
--principal=oryx/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:34639
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=41949
--tserver_master_addrs=127.18.163.254:36995
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:45.187008 29152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:45.188465 29152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:45.202845 29180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:45.203337 29179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:45.203416 29184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:45.204164 29152 server_base.cc:1034] running on GCE node
I20260812 00:21:45.204938 29152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:45.206127 29152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:45.207365 29152 hybrid_clock.cc:648] HybridClock initialized: now 1786494105207296 us; error 64 us; skew 500 ppm
I20260812 00:21:45.207720 29152 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:45 dist-test-slave-njxd krb5kdc[28473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494105, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:45.211283 29152 init.cc:377] Logged in from keytab as oryx/127.18.163.193@KRBTEST.COM (short username oryx)
I20260812 00:21:45.213078 29152 webserver.cc:460] Webserver started at http://127.18.163.193:41949/ using document root <none> and password file <none>
I20260812 00:21:45.214102 29152 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:45.214282 29152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:45.220613 29152 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 00:21:45.223985 29191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:45.225823 29152 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:21:45.226043 29152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "e2023205709f4d5a99a872a585fb0084"
format_stamp: "Formatted at 2026-08-12 00:21:42 on dist-test-slave-njxd"
server_key: "e992c9127050177a6f1efb6a60a2a09b"
server_key_iv: "e447f7638932ad20254c57b6a7c95149"
server_key_version: "encryptionkey@0"
I20260812 00:21:45.227128 29152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:45.242519 29152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:45.247112 29152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:45.247432 29152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:45.248533 29152 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:45.250164 29152 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:45.250264 29152 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:45.250430 29152 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:45.250532 29152 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:45.287583 29152 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:34639
I20260812 00:21:45.287688 29319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:34639 every 8 connection(s)
I20260812 00:21:45.289247 29152 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:21:45.292764 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 29152
I20260812 00:21:45.293736 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:44851
--local_ip_for_outbound_sockets=127.18.163.194
--tserver_master_addrs=127.18.163.254:36995
--webserver_port=38429
--webserver_interface=127.18.163.194
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:33509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.18.163.194
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.194.keytab with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:21:45 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:45 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:45.310365 29325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:45.292508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:49213)
0812 00:21:45.293752 (+ 1244us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:45.293795 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:45.295735 (+ 1940us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:45.297430 (+ 1695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:45.297443 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:45.298178 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:45.298789 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:45.298810 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.300623 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.300628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:45.302125 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:45.302142 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.303310 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.303319 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:45.303619 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:45.304417 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:45.304444 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:45.309025 (+ 4581us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":912,"thread_start_us":702,"threads_started":1}
W20260812 00:21:45.310916 29323 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:45.292450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:49213 (local address 127.18.163.254:36995)
0812 00:21:45.293217 (+ 767us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:45.293240 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:45.293969 (+ 729us) server_negotiation.cc:407] Connection header received
0812 00:21:45.296400 (+ 2431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:45.296415 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:45.296807 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:45.297236 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:45.299045 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.300417 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.302297 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.303018 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.303252 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:45.309619 (+ 6367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:49213: BlockingRecv error: recv got EOF from 127.18.163.193:49213 (error 108)
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":303,"threads_started":1}
W20260812 00:21:45.311234 29321 heartbeater.cc:644] Failed to heartbeat to 127.18.163.254:36995 (0 consecutive failures): Not authorized: Failed to ping master at 127.18.163.254:36995: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Aug 12 00:21:45 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:45 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:45.320858 29325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:45.312011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:35411)
0812 00:21:45.312247 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:45.312269 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:45.312408 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:45.312782 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:45.312789 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:45.313173 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:45.313333 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:45.313341 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.314475 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.314481 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:45.315426 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:45.315438 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.316241 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.316247 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:45.316433 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:45.317100 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:45.317119 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:45.320516 (+ 3397us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":82}
W20260812 00:21:45.321384 29323 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:45.312134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:35411 (local address 127.18.163.254:36995)
0812 00:21:45.312322 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:45.312328 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:45.312349 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:21:45.312550 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:45.312562 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:45.312627 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:45.312740 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:45.313487 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.314310 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.315581 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.316006 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.316225 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:45.320804 (+ 4579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:35411: BlockingRecv error: recv got EOF from 127.18.163.193:35411 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 12 00:21:45 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:45 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:45.330547 29325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:45.321664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:54029)
0812 00:21:45.321825 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:45.321845 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:45.321946 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:45.322495 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:45.322500 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:45.322849 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:45.323010 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:45.323020 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.324104 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.324108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:45.325071 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:45.325084 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.325916 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.325922 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:45.326163 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:45.326841 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:45.326860 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:45.330080 (+ 3220us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 00:21:45.330691 29323 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:45.322019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:54029 (local address 127.18.163.254:36995)
0812 00:21:45.322201 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:45.322206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:45.322221 (+ 15us) server_negotiation.cc:407] Connection header received
0812 00:21:45.322282 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:45.322285 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:45.322343 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:45.322459 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:45.323176 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.323928 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.325236 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.325752 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.325897 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:45.330325 (+ 4428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:54029: BlockingRecv error: recv got EOF from 127.18.163.193:54029 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260812 00:21:45.331044 29321 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:21:45.676188 29327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:45.676522 29327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:45.676623 29327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:45.684427 29327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:45.684566 29327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:45.684684 29327 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:21:45.695312 29327 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:33509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.194.keytab
--principal=oryx/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:44851
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=38429
--tserver_master_addrs=127.18.163.254:36995
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:45.696764 29327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:45.698205 29327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:45.713366 29332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:45.713300 29333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:45.713362 29335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:45.714841 29327 server_base.cc:1034] running on GCE node
I20260812 00:21:45.715595 29327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:45.716741 29327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:45.717999 29327 hybrid_clock.cc:648] HybridClock initialized: now 1786494105717919 us; error 81 us; skew 500 ppm
I20260812 00:21:45.718393 29327 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:45 dist-test-slave-njxd krb5kdc[28473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494105, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:45.722563 29327 init.cc:377] Logged in from keytab as oryx/127.18.163.194@KRBTEST.COM (short username oryx)
I20260812 00:21:45.725199 29327 webserver.cc:460] Webserver started at http://127.18.163.194:38429/ using document root <none> and password file <none>
I20260812 00:21:45.726205 29327 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:45.726414 29327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:45.733223 29327 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.004s
I20260812 00:21:45.736688 29343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:45.738940 29327 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:21:45.739176 29327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "b8916a01bb204c6b842f88c8534f4e26"
format_stamp: "Formatted at 2026-08-12 00:21:42 on dist-test-slave-njxd"
server_key: "fe9108c9773809d0a8d2a1afecffb580"
server_key_iv: "c64d84520765990d317d51dfd5218f9b"
server_key_version: "encryptionkey@0"
I20260812 00:21:45.740605 29327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:45.764322 29327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:45.769073 29327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:45.769336 29327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:45.770511 29327 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:45.772125 29327 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:45.772221 29327 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:45.772313 29327 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:45.772370 29327 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:45.809371 29327 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:44851
I20260812 00:21:45.809484 29474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:44851 every 8 connection(s)
I20260812 00:21:45.811086 29327 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:21:45.821432 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 29327
I20260812 00:21:45.822314 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:42393
--local_ip_for_outbound_sockets=127.18.163.195
--tserver_master_addrs=127.18.163.254:36995
--webserver_port=45593
--webserver_interface=127.18.163.195
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:33509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.18.163.195
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.195.keytab with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:21:45 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:45 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:21:45.828734 29323 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:45.813869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:46503 (local address 127.18.163.254:36995)
0812 00:21:45.814067 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:45.814072 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:45.815332 (+ 1260us) server_negotiation.cc:407] Connection header received
0812 00:21:45.817269 (+ 1937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:45.817274 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:45.817353 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:45.817453 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:45.819315 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.820104 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.821889 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.822716 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.822888 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:45.828392 (+ 5504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:46503: BlockingRecv error: recv got EOF from 127.18.163.194:46503 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:21:45.829299 29477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:45.814375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:46503)
0812 00:21:45.815139 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:45.815186 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:45.816957 (+ 1771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:45.817815 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:45.817825 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:45.818414 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:45.819070 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:45.819092 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.820289 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.820293 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:45.821686 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:45.821702 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.822979 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.822984 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:45.823212 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:45.823985 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:45.824015 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:45.828087 (+ 4072us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":313,"threads_started":1}
W20260812 00:21:45.830245 29475 heartbeater.cc:644] Failed to heartbeat to 127.18.163.254:36995 (0 consecutive failures): Not authorized: Failed to ping master at 127.18.163.254:36995: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Aug 12 00:21:45 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:45 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:45.841012 29477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:45.830978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:35275)
0812 00:21:45.831352 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:45.831369 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:45.831479 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:45.831902 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:45.831905 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:45.832305 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:45.832462 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:45.832470 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.833945 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.833949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:45.834878 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:45.834891 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.835938 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.835947 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:45.836169 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:45.836873 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:45.836901 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:45.840681 (+ 3780us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":256}
W20260812 00:21:45.841205 29323 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:45.831077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:35275 (local address 127.18.163.254:36995)
0812 00:21:45.831364 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:45.831373 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:45.831423 (+ 50us) server_negotiation.cc:407] Connection header received
0812 00:21:45.831632 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:45.831639 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:45.831755 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:45.831868 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:45.832614 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.833803 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.835044 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.835754 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.835867 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:45.840952 (+ 5085us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:35275: BlockingRecv error: recv got EOF from 127.18.163.194:35275 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 12 00:21:45 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:45 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:21:45.851287 29323 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:45.842165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:44547 (local address 127.18.163.254:36995)
0812 00:21:45.842367 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:45.842375 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:45.842398 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:21:45.842471 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:45.842475 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:45.842552 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:45.842671 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:45.843386 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.844117 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.845372 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.845888 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.846041 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:45.851097 (+ 5056us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:44547: BlockingRecv error: recv got EOF from 127.18.163.194:44547 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:21:45.851276 29477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:45.841979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:44547)
0812 00:21:45.842165 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:45.842184 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:45.842335 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:45.842705 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:45.842709 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:45.843067 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:45.843228 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:45.843236 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.844272 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.844277 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:45.845223 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:45.845235 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:45.846064 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:45.846070 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:45.846320 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:45.846988 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:45.847007 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:45.850849 (+ 3842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 00:21:45.851806 29475 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:21:46.201009 29478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:21:46.201329 29478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:21:46.201439 29478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:21:46.209199 29478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:21:46.209342 29478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:21:46.209532 29478 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:21:46.220293 29478 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:33509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/krb5kdc/oryx_127.18.163.195.keytab
--principal=oryx/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:42393
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=45593
--tserver_master_addrs=127.18.163.254:36995
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:21:46.221732 29478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:21:46.223132 29478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:21:46.238008 29483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:46.237932 29484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:21:46.237983 29487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:21:46.238960 29478 server_base.cc:1034] running on GCE node
I20260812 00:21:46.239665 29478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:21:46.240739 29478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:21:46.241982 29478 hybrid_clock.cc:648] HybridClock initialized: now 1786494106241921 us; error 54 us; skew 500 ppm
I20260812 00:21:46.242343 29478 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:21:46 dist-test-slave-njxd krb5kdc[28473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494106, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:21:46.245976 29478 init.cc:377] Logged in from keytab as oryx/127.18.163.195@KRBTEST.COM (short username oryx)
I20260812 00:21:46.248083 29478 webserver.cc:460] Webserver started at http://127.18.163.195:45593/ using document root <none> and password file <none>
I20260812 00:21:46.248893 29478 fs_manager.cc:359] Metadata directory not provided
I20260812 00:21:46.249068 29478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:21:46.255302 29478 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 00:21:46.258427 29494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:46.260030 29478 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:21:46.260246 29478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "7cf290eadbc545aea2619a186b02e0bf"
format_stamp: "Formatted at 2026-08-12 00:21:43 on dist-test-slave-njxd"
server_key: "fa089a10158f025a63133576d5c4f2e4"
server_key_iv: "4c813118443decc37d833ff956c743a4"
server_key_version: "encryptionkey@0"
I20260812 00:21:46.261416 29478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:21:46.282272 29478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:21:46.286819 29478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:21:46.287206 29478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:21:46.288415 29478 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:21:46.289984 29478 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:21:46.290144 29478 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:46.290293 29478 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:21:46.290382 29478 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:21:46.326574 29478 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:42393
I20260812 00:21:46.326637 29637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:42393 every 8 connection(s)
I20260812 00:21:46.328202 29478 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:21:46.329229 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 29478
Aug 12 00:21:46 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:46 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:46.343890 29642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:46.331874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:46995)
0812 00:21:46.332413 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:46.332433 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:46.332556 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:46.333405 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:46.333414 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:46.334146 (+ 732us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:46.334423 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:46.334438 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.335827 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.335833 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:46.337397 (+ 1564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:46.337418 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.338590 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.338597 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:46.338814 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:46.339506 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:46.339535 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:46.343512 (+ 3977us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":277,"threads_started":1}
W20260812 00:21:46.344996 29643 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:46.332140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:46995 (local address 127.18.163.254:36995)
0812 00:21:46.333053 (+ 913us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:46.333059 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:46.333075 (+ 16us) server_negotiation.cc:407] Connection header received
0812 00:21:46.333118 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:46.333124 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:46.333198 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:46.333313 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:46.334661 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.335635 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.337607 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.338356 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.338482 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:46.344614 (+ 6132us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:46995: BlockingRecv error: recv got EOF from 127.18.163.193:46995 (error 108)
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":795,"thread_start_us":647,"threads_started":1}
Aug 12 00:21:46 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:46 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:46.350580 29323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:46.330420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52982 (local address 127.18.163.254:36995)
0812 00:21:46.330674 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:46.330684 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:46.331355 (+ 671us) server_negotiation.cc:407] Connection header received
0812 00:21:46.332600 (+ 1245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:46.332609 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:46.332916 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:46.333008 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:46.335420 (+ 2412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.336436 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.337979 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.338578 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.338707 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:46.342417 (+ 3710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:21:46.342429 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:21:46.342454 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:21:46.342516 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:21:46.346509 (+ 3993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:46.347549 (+ 1040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:46.347557 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:46.347564 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:46.347769 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:21:46.348242 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:21:46.348247 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:21:46.348251 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:21:46.348954 (+ 703us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:21:46.349340 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0812 00:21:46.349711 (+ 371us) server_negotiation.cc:299] Negotiation successful
0812 00:21:46.350113 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":77}
I20260812 00:21:46.351495 29644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:46.332083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:42903)
0812 00:21:46.334157 (+ 2074us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:46.334224 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:46.336797 (+ 2573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:46.337720 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:46.337733 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:46.338613 (+ 880us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:46.339554 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:46.339590 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.341233 (+ 1643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.341237 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:46.343139 (+ 1902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:46.343154 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.344589 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.344599 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:46.344949 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:46.345726 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:46.345757 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:46.350326 (+ 4569us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1698,"thread_start_us":1454,"threads_started":1}
W20260812 00:21:46.352389 29638 heartbeater.cc:644] Failed to heartbeat to 127.18.163.254:36995 (0 consecutive failures): Not authorized: Failed to ping master at 127.18.163.254:36995: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
W20260812 00:21:46.353052 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:46.331429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:42903 (local address 127.18.163.254:36995)
0812 00:21:46.331956 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:46.331963 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:46.334670 (+ 2707us) server_negotiation.cc:407] Connection header received
0812 00:21:46.337120 (+ 2450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:46.337126 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:46.337235 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:46.337347 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:46.339769 (+ 2422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.341049 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.343342 (+ 2293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.344005 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.344155 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:46.350588 (+ 6433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.195:42903: BlockingRecv error: recv got EOF from 127.18.163.195:42903 (error 108)
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":257,"threads_started":1}
Aug 12 00:21:46 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:46 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:46.361440 29644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:46.353014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:55307)
0812 00:21:46.353423 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:46.353446 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:46.353565 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:46.353947 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:46.353955 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:46.354426 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:46.354624 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:46.354634 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.355732 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.355736 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:46.356648 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:46.356660 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.357302 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.357306 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:46.357434 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:46.358055 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:46.358073 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:46.361107 (+ 3034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":264}
W20260812 00:21:46.361665 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:46.353342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:55307 (local address 127.18.163.254:36995)
0812 00:21:46.353638 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:46.353646 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:46.353665 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:21:46.353710 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:46.353714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:46.353792 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:46.353881 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:46.354754 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.355611 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.356777 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.357174 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.357274 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:46.361376 (+ 4102us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.195:55307: BlockingRecv error: recv got EOF from 127.18.163.195:55307 (error 108)
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":163}
Aug 12 00:21:46 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:46 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:46.371084 29644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:46.362289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:36501)
0812 00:21:46.362480 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:46.362503 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:46.362616 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:46.362937 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:46.362940 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:46.363261 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:46.363421 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:46.363430 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.364422 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.364426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:46.365775 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:46.365794 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.366828 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.366836 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:46.367065 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:46.367734 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:46.367754 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:46.370751 (+ 2997us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":58}
W20260812 00:21:46.371294 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:46.362432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:36501 (local address 127.18.163.254:36995)
0812 00:21:46.362609 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:46.362614 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:46.362632 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:21:46.362732 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:46.362735 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:46.362809 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:46.362894 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:46.363546 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.364277 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.366022 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.366675 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.366780 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:46.371005 (+ 4225us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.195:36501: BlockingRecv error: recv got EOF from 127.18.163.195:36501 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260812 00:21:46.371471 29638 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 00:21:46 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:46 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:46.861977 29645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:46.852616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:43951)
0812 00:21:46.853180 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:46.853197 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:46.853372 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:46.853816 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:46.853821 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:46.854418 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:46.854641 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:46.854652 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.855691 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.855701 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:46.856701 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:46.856713 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.857492 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.857498 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:46.857711 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:46.858334 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:46.858352 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:46.861722 (+ 3370us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":309,"threads_started":1}
W20260812 00:21:46.862149 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:46.852701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:43951 (local address 127.18.163.254:36995)
0812 00:21:46.852955 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:46.852965 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:46.853296 (+ 331us) server_negotiation.cc:407] Connection header received
0812 00:21:46.853515 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:46.853519 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:46.853667 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:46.853779 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:46.854802 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.855517 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.856854 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:46.857294 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:46.857440 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:46.861938 (+ 4498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:43951: BlockingRecv error: recv got EOF from 127.18.163.194:43951 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 12 00:21:47 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:47 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:47.357120 29647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:47.345104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:56365)
0812 00:21:47.345750 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:47.345774 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:47.345998 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:47.346452 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:47.346457 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:47.347109 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:47.347415 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:47.347433 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:47.349115 (+ 1682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:47.349119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:47.350532 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:47.350553 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:47.351592 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:47.351600 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:47.351807 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:47.352543 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:47.352567 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:47.356847 (+ 4280us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":335,"threads_started":1}
W20260812 00:21:47.357402 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:47.345142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:56365 (local address 127.18.163.254:36995)
0812 00:21:47.345377 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:47.345387 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:47.345866 (+ 479us) server_negotiation.cc:407] Connection header received
0812 00:21:47.346172 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:47.346177 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:47.346265 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:47.346374 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:47.347639 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:47.348943 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:47.350708 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:47.351408 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:47.351542 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:47.357109 (+ 5567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:56365: BlockingRecv error: recv got EOF from 127.18.163.193:56365 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 12 00:21:47 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:47 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:47.381989 29649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:47.372188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:49321)
0812 00:21:47.372727 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:47.372744 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:47.372882 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:47.373246 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:47.373250 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:47.373881 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:47.374099 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:47.374110 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:47.375162 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:47.375166 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:47.376173 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:47.376185 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:47.377139 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:47.377148 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:47.377360 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:47.378170 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:47.378192 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:47.381731 (+ 3539us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":279,"threads_started":1}
W20260812 00:21:47.382169 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:47.372354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:49321 (local address 127.18.163.254:36995)
0812 00:21:47.372610 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:47.372617 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:47.372832 (+ 215us) server_negotiation.cc:407] Connection header received
0812 00:21:47.373000 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:47.373004 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:47.373072 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:47.373166 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:47.374256 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:47.375018 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:47.376359 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:47.376840 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:47.376963 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:47.381944 (+ 4981us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.195:49321: BlockingRecv error: recv got EOF from 127.18.163.195:49321 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
Aug 12 00:21:47 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:47 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:47.872108 29650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:47.862986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:41789)
0812 00:21:47.863503 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:47.863522 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:47.863667 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:47.864003 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:47.864006 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:47.864545 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:47.864757 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:47.864767 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:47.865938 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:47.865942 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:47.866948 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:47.866962 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:47.867670 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:47.867674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:47.867791 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:47.868486 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:47.868507 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:47.871717 (+ 3210us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":287,"threads_started":1}
W20260812 00:21:47.872325 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:47.863049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:41789 (local address 127.18.163.254:36995)
0812 00:21:47.863314 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:47.863322 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:47.863617 (+ 295us) server_negotiation.cc:407] Connection header received
0812 00:21:47.863792 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:47.863797 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:47.863866 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:47.863957 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:47.864898 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:47.865805 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:47.867075 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:47.867516 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:47.867616 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:47.871984 (+ 4368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:41789: BlockingRecv error: recv got EOF from 127.18.163.194:41789 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 12 00:21:48 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:48 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:48.367445 29651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:48.358284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:39869)
0812 00:21:48.358814 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:48.358831 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:48.358955 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:48.359293 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:48.359296 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:48.359658 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:48.359835 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:48.359843 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:48.361058 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:48.361069 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:48.362170 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:48.362186 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:48.363080 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:48.363086 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:48.363230 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:48.363860 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:48.363879 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:48.367045 (+ 3166us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":315,"threads_started":1}
W20260812 00:21:48.367584 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:48.358541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:39869 (local address 127.18.163.254:36995)
0812 00:21:48.358822 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:48.358832 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:48.358906 (+ 74us) server_negotiation.cc:407] Connection header received
0812 00:21:48.359066 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:48.359070 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:48.359147 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:48.359236 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:48.359972 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:48.360889 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:48.362330 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:48.362920 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:48.363031 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:48.367337 (+ 4306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:39869: BlockingRecv error: recv got EOF from 127.18.163.193:39869 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 12 00:21:48 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:48 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:48.392702 29653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:48.383286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:51807)
0812 00:21:48.383959 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:48.383977 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:48.384113 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:48.384494 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:48.384497 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:48.384951 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:48.385141 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:48.385151 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:48.386380 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:48.386388 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:48.387621 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:48.387641 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:48.388315 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:48.388319 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:48.388438 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:48.389065 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:48.389085 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:48.392323 (+ 3238us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":405,"threads_started":1}
W20260812 00:21:48.392908 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:48.383368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:51807 (local address 127.18.163.254:36995)
0812 00:21:48.383551 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:48.383557 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:48.384063 (+ 506us) server_negotiation.cc:407] Connection header received
0812 00:21:48.384232 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:48.384236 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:48.384331 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:48.384430 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:48.385306 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:48.386215 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:48.387768 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:48.388171 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:48.388279 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:48.392646 (+ 4367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.195:51807: BlockingRecv error: recv got EOF from 127.18.163.195:51807 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 12 00:21:48 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:48 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:48.882783 29654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:48.873261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:46313)
0812 00:21:48.873872 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:48.873890 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:48.874025 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:48.874367 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:48.874371 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:48.874776 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:48.875012 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:48.875028 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:48.876553 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:48.876557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:48.877747 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:48.877772 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:48.878521 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:48.878526 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:48.878666 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:48.879328 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:48.879347 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:48.882483 (+ 3136us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":367,"threads_started":1}
W20260812 00:21:48.883008 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:48.873406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:46313 (local address 127.18.163.254:36995)
0812 00:21:48.873724 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:48.873731 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:48.873984 (+ 253us) server_negotiation.cc:407] Connection header received
0812 00:21:48.874159 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:48.874163 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:48.874233 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:48.874317 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:48.875232 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:48.876386 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:48.877922 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:48.878378 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:48.878483 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:48.882764 (+ 4281us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:46313: BlockingRecv error: recv got EOF from 127.18.163.194:46313 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 12 00:21:49 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:49 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:49.377717 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:49.368644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:49911)
0812 00:21:49.369311 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:49.369334 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:49.369493 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:49.369914 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:49.369918 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:49.370320 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:49.370480 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:49.370488 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:49.371532 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:49.371536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:49.372541 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:49.372554 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:49.373318 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:49.373322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:49.373459 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:49.374114 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:49.374131 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:49.377322 (+ 3191us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":400,"threads_started":1}
W20260812 00:21:49.377944 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:49.368691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:49911 (local address 127.18.163.254:36995)
0812 00:21:49.368965 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:49.368975 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:49.369457 (+ 482us) server_negotiation.cc:407] Connection header received
0812 00:21:49.369642 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:49.369647 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:49.369759 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:49.369847 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:49.370619 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:49.371387 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:49.372700 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:49.373178 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:49.373284 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:49.377631 (+ 4347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:49911: BlockingRecv error: recv got EOF from 127.18.163.193:49911 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 12 00:21:49 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:49 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:49.403071 29656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:49.393963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:43077)
0812 00:21:49.394546 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:49.394563 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:49.394735 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:49.395128 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:49.395133 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:49.395539 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:49.395715 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:49.395725 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:49.396831 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:49.396835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:49.397856 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:49.397870 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:49.398558 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:49.398562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:49.398802 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:49.399492 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:49.399512 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:49.402789 (+ 3277us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":314,"threads_started":1}
W20260812 00:21:49.403362 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:49.394019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:43077 (local address 127.18.163.254:36995)
0812 00:21:49.394199 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:49.394204 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:49.394657 (+ 453us) server_negotiation.cc:407] Connection header received
0812 00:21:49.394873 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:49.394879 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:49.394978 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:49.395086 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:49.395873 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:49.396642 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:49.398007 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:49.398428 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:49.398526 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:49.403059 (+ 4533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.195:43077: BlockingRecv error: recv got EOF from 127.18.163.195:43077 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 12 00:21:49 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:49 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:49.899381 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:49.883966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:39707)
0812 00:21:49.884514 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:49.884532 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:49.884675 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:49.885014 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:49.885017 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:49.885445 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:49.885683 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:49.885696 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:49.887022 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:49.887026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:49.888422 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:49.888444 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:49.889182 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:49.889186 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:49.889314 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:49.895686 (+ 6372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:49.895711 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:49.899076 (+ 3365us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":286,"threads_started":1}
W20260812 00:21:49.899785 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:49.884250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:39707 (local address 127.18.163.254:36995)
0812 00:21:49.884518 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:49.884525 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:49.884649 (+ 124us) server_negotiation.cc:407] Connection header received
0812 00:21:49.884798 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:49.884802 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:49.884873 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:49.884966 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:49.885839 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:49.886854 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:49.888597 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:49.889043 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:49.889145 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:49.899486 (+ 10341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:39707: BlockingRecv error: recv got EOF from 127.18.163.194:39707 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Aug 12 00:21:50 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:50 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:50.388367 29658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:50.379045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:45763)
0812 00:21:50.379684 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:50.379708 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:50.379863 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:50.380242 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:50.380250 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:50.380740 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:50.380925 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:50.380935 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:50.382063 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:50.382069 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:50.383065 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:50.383080 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:50.383908 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:50.383913 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:50.384121 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:50.384812 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:50.384832 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:50.387990 (+ 3158us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":315,"threads_started":1}
W20260812 00:21:50.388517 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:50.379140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:45763 (local address 127.18.163.254:36995)
0812 00:21:50.379415 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:50.379424 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:50.379804 (+ 380us) server_negotiation.cc:407] Connection header received
0812 00:21:50.380017 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:50.380021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:50.380087 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:50.380195 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:50.381084 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:50.381917 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:50.383248 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:50.383732 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:50.383880 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:50.388256 (+ 4376us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:45763: BlockingRecv error: recv got EOF from 127.18.163.193:45763 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 12 00:21:50 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:50 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:50.413570 29660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:50.404269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:53659)
0812 00:21:50.404815 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:50.404833 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:50.404993 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:50.405450 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:50.405456 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:50.406057 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:50.406248 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:50.406259 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:50.407319 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:50.407327 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:50.408460 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:50.408473 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:50.409183 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:50.409188 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:50.409320 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:50.409993 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:50.410013 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:50.413200 (+ 3187us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":298,"threads_started":1}
W20260812 00:21:50.413841 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:50.404378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:53659 (local address 127.18.163.254:36995)
0812 00:21:50.404592 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:50.404598 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:50.404900 (+ 302us) server_negotiation.cc:407] Connection header received
0812 00:21:50.405138 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:50.405141 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:50.405217 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:50.405345 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:50.406386 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:50.407143 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:50.408607 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:50.409043 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:50.409143 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:50.413477 (+ 4334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.195:53659: BlockingRecv error: recv got EOF from 127.18.163.195:53659 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 12 00:21:50 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:50 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:50.909283 29661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:50.900588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:56925)
0812 00:21:50.901141 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:50.901158 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:50.901282 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:50.901706 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:50.901709 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:50.902228 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:50.902415 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:50.902427 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:50.903461 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:50.903465 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:50.904412 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:50.904425 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:50.905155 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:50.905159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:50.905304 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:50.906004 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:50.906024 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:50.908994 (+ 2970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":268,"threads_started":1}
W20260812 00:21:50.909595 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:50.900729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:56925 (local address 127.18.163.254:36995)
0812 00:21:50.900987 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:50.900995 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:50.901242 (+ 247us) server_negotiation.cc:407] Connection header received
0812 00:21:50.901438 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:50.901444 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:50.901519 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:50.901660 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:50.902595 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:50.903333 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:50.904575 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:50.905007 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:50.905125 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:50.909275 (+ 4150us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:56925: BlockingRecv error: recv got EOF from 127.18.163.194:56925 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
Aug 12 00:21:51 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:51 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:51.398509 29663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:51.389567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:54687)
0812 00:21:51.390160 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:51.390176 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:51.390342 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:51.390676 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:51.390680 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:51.391144 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:51.391321 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:51.391331 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:51.392443 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:51.392449 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:51.393376 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:51.393390 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:51.394226 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:51.394232 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:51.394430 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:51.395063 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:51.395081 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:51.398151 (+ 3070us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":327,"threads_started":1}
W20260812 00:21:51.398713 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:51.389684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:54687 (local address 127.18.163.254:36995)
0812 00:21:51.389925 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:51.389934 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:51.390274 (+ 340us) server_negotiation.cc:407] Connection header received
0812 00:21:51.390466 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:51.390476 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:51.390541 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:51.390647 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:51.391474 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:51.392283 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:51.393536 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:51.394052 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:51.394195 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:51.398431 (+ 4236us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:54687: BlockingRecv error: recv got EOF from 127.18.163.193:54687 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 12 00:21:51 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:51 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:51.422876 29664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:51.414715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:50067)
0812 00:21:51.415305 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:51.415322 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:51.415437 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:51.415756 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:51.415760 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:51.416180 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:51.416349 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:51.416358 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:51.417346 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:51.417349 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:51.418367 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:51.418379 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:51.419054 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:51.419059 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:51.419180 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:51.419770 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:51.419789 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:51.422604 (+ 2815us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":305,"threads_started":1}
W20260812 00:21:51.423102 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:51.414820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:50067 (local address 127.18.163.254:36995)
0812 00:21:51.414984 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:51.414990 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:51.415395 (+ 405us) server_negotiation.cc:407] Connection header received
0812 00:21:51.415542 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:51.415546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:51.415622 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:51.415712 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:51.416475 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:51.417211 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:51.418497 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:51.418924 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:51.419022 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:51.422867 (+ 3845us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.195:50067: BlockingRecv error: recv got EOF from 127.18.163.195:50067 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 12 00:21:51 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:51 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:51.919520 29666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:51.910563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:45765)
0812 00:21:51.911232 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:51.911256 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:51.911404 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:51.911753 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:51.911758 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:51.912259 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:51.912427 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:51.912436 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:51.913518 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:51.913523 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:51.914487 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:51.914501 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:51.915290 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:51.915296 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:51.915491 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:51.916175 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:51.916194 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:51.919272 (+ 3078us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":344,"threads_started":1}
W20260812 00:21:51.919843 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:51.910665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:45765 (local address 127.18.163.254:36995)
0812 00:21:51.910874 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:51.910883 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:51.911332 (+ 449us) server_negotiation.cc:407] Connection header received
0812 00:21:51.911543 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:51.911548 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:51.911619 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:51.911722 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:51.912585 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:51.913351 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:51.914673 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:51.915109 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:51.915254 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:51.919560 (+ 4306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:45765: BlockingRecv error: recv got EOF from 127.18.163.194:45765 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 12 00:21:52 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:52 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:52.409476 29667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:52.399837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:41961)
0812 00:21:52.400522 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:52.400543 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:52.400720 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:52.401155 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:52.401161 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:52.401721 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:52.402000 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:52.402016 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:52.403095 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:52.403101 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:52.404288 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:52.404304 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:52.405158 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:52.405163 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:52.405368 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:52.406114 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:52.406133 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:52.409185 (+ 3052us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":310,"threads_started":1}
W20260812 00:21:52.409690 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:52.399905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:41961 (local address 127.18.163.254:36995)
0812 00:21:52.400139 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:52.400149 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:52.400640 (+ 491us) server_negotiation.cc:407] Connection header received
0812 00:21:52.400867 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:52.400872 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:52.400978 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:52.401088 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:52.402172 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:52.402940 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:52.404446 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:52.404968 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:52.405122 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:52.409441 (+ 4319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:41961: BlockingRecv error: recv got EOF from 127.18.163.193:41961 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 12 00:21:52 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:52 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:52.434052 29668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:52.424218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:51593)
0812 00:21:52.424762 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:52.424779 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:52.424914 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:52.425238 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:52.425241 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:52.425804 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:52.425988 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:52.425998 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:52.427104 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:52.427109 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:52.428079 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:52.428094 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:52.428821 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:52.428826 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:52.428965 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:52.429781 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:52.429809 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:52.433696 (+ 3887us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":285,"threads_started":1}
W20260812 00:21:52.434226 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:52.424304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:51593 (local address 127.18.163.254:36995)
0812 00:21:52.424556 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:52.424563 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:52.424869 (+ 306us) server_negotiation.cc:407] Connection header received
0812 00:21:52.425029 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:52.425032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:52.425102 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:52.425192 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:52.426142 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:52.426936 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:52.428231 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:52.428666 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:52.428770 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:52.433952 (+ 5182us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.195:51593: BlockingRecv error: recv got EOF from 127.18.163.195:51593 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 12 00:21:52 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:52 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:52.930267 29669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:52.920725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:41627)
0812 00:21:52.921306 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:52.921324 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:52.921456 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:52.921926 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:52.921932 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:52.922591 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:52.922779 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:52.922789 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:52.924195 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:52.924199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:52.925188 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:52.925200 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:52.925924 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:52.925929 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:52.926069 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:52.926699 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:52.926717 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:52.929858 (+ 3141us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":265,"threads_started":1}
W20260812 00:21:52.930408 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:52.920809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:41627 (local address 127.18.163.254:36995)
0812 00:21:52.921069 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:52.921080 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:52.921437 (+ 357us) server_negotiation.cc:407] Connection header received
0812 00:21:52.921613 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:52.921618 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:52.921705 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:52.921823 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:52.922938 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:52.924046 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:52.925321 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:52.925761 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:52.925860 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:52.930143 (+ 4283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:41627: BlockingRecv error: recv got EOF from 127.18.163.194:41627 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 12 00:21:53 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:53 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:53.420337 29670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:53.410814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:48551)
0812 00:21:53.411384 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:53.411402 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:53.411544 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:53.411886 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:53.411889 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:53.412339 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:53.412510 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:53.412518 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:53.413707 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:53.413711 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:53.414705 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:53.414720 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:53.415589 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:53.415618 (+ 29us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:53.415808 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:53.416608 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:53.416634 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:53.420072 (+ 3438us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":302,"threads_started":1}
W20260812 00:21:53.420585 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:53.410956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:48551 (local address 127.18.163.254:36995)
0812 00:21:53.411223 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:53.411231 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:53.411496 (+ 265us) server_negotiation.cc:407] Connection header received
0812 00:21:53.411664 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:53.411668 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:53.411738 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:53.411834 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:53.412681 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:53.413455 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:53.414859 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:53.415341 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:53.415506 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:53.420306 (+ 4800us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:48551: BlockingRecv error: recv got EOF from 127.18.163.193:48551 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 12 00:21:53 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:53 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:53.445041 29671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:53.435203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:55513)
0812 00:21:53.435817 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:53.435835 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:53.435974 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:53.436316 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:53.436320 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:53.436768 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:53.436957 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:53.436966 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:53.438140 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:53.438145 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:53.439131 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:53.439145 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:53.439898 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:53.439903 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:53.440042 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:53.440740 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:53.440767 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:53.444611 (+ 3844us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":284,"threads_started":1}
W20260812 00:21:53.445142 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:53.435349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:55513 (local address 127.18.163.254:36995)
0812 00:21:53.435609 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:53.435617 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:53.435925 (+ 308us) server_negotiation.cc:407] Connection header received
0812 00:21:53.436087 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:53.436091 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:53.436160 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:53.436250 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:53.437098 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:53.437960 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:53.439280 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:53.439716 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:53.439819 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:53.444885 (+ 5066us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.195:55513: BlockingRecv error: recv got EOF from 127.18.163.195:55513 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 12 00:21:53 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:53 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:53.941275 29672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:53.931568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:57567)
0812 00:21:53.932191 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:53.932214 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:53.932378 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:53.932805 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:53.932809 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:53.933321 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:53.933532 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:53.933545 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:53.934868 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:53.934879 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:53.935837 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:53.935849 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:53.936661 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:53.936667 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:53.936849 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:53.937639 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:53.937670 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:53.940897 (+ 3227us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":312,"threads_started":1}
W20260812 00:21:53.941478 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:53.931704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:57567 (local address 127.18.163.254:36995)
0812 00:21:53.931898 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:53.931903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:53.932311 (+ 408us) server_negotiation.cc:407] Connection header received
0812 00:21:53.932530 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:53.932536 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:53.932647 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:53.932755 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:53.933717 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:53.934706 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:53.935999 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:53.936446 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:53.936592 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:53.941191 (+ 4599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:57567: BlockingRecv error: recv got EOF from 127.18.163.194:57567 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 12 00:21:54 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:54 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:54.430917 29673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:54.421567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:47853)
0812 00:21:54.422189 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:54.422206 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:54.422334 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:54.422728 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:54.422732 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:54.423143 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:54.423327 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:54.423336 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:54.424396 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:54.424400 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:54.425402 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:54.425416 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:54.426432 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:54.426438 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:54.426628 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:54.427332 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:54.427357 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:54.430619 (+ 3262us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":330,"threads_started":1}
W20260812 00:21:54.431118 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:54.421667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:47853 (local address 127.18.163.254:36995)
0812 00:21:54.421868 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:54.421873 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:54.422290 (+ 417us) server_negotiation.cc:407] Connection header received
0812 00:21:54.422457 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:54.422461 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:54.422528 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:54.422649 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:54.423467 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:54.424264 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:54.425553 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:54.426230 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:54.426381 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:54.430878 (+ 4497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:47853: BlockingRecv error: recv got EOF from 127.18.163.193:47853 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 12 00:21:54 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:54 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:54.455662 29674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:54.446248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:54257)
0812 00:21:54.446845 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:54.446862 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:54.447028 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:54.447463 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:54.447467 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:54.447893 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:54.448065 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:54.448074 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:54.449089 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:54.449093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:54.450276 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:54.450290 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:54.451056 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:54.451063 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:54.451251 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:54.451959 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:54.451984 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:54.455296 (+ 3312us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":293,"threads_started":1}
W20260812 00:21:54.455840 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:54.446399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:54257 (local address 127.18.163.254:36995)
0812 00:21:54.446632 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:54.446641 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:54.446950 (+ 309us) server_negotiation.cc:407] Connection header received
0812 00:21:54.447192 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:54.447196 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:54.447264 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:54.447365 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:54.448199 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:54.448949 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:54.450427 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:54.450858 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:54.451001 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:54.455547 (+ 4546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.195:54257: BlockingRecv error: recv got EOF from 127.18.163.195:54257 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 12 00:21:54 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:54 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:54.956231 29675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:54.942314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:46679)
0812 00:21:54.942830 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:54.942847 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:54.942981 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:54.943305 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:54.943308 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:54.943722 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:54.943897 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:54.943906 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:54.944980 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:54.944984 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:54.946068 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:54.946082 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:54.946882 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:54.946886 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:54.947027 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:54.952344 (+ 5317us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:54.952373 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:54.955847 (+ 3474us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":268,"threads_started":1}
W20260812 00:21:54.956333 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:54.942398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:46679 (local address 127.18.163.254:36995)
0812 00:21:54.942666 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:54.942673 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:54.942928 (+ 255us) server_negotiation.cc:407] Connection header received
0812 00:21:54.943088 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:54.943091 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:54.943161 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:54.943247 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:54.944060 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:54.944836 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:54.946222 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:54.946735 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:54.946843 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:54.956132 (+ 9289us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:46679: BlockingRecv error: recv got EOF from 127.18.163.194:46679 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 12 00:21:55 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:55 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:55.441275 29677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:55.432035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:44165)
0812 00:21:55.432686 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:55.432704 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:55.432830 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:55.433155 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:55.433159 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:55.433563 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:55.433773 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:55.433783 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:55.435169 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:55.435174 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:55.436373 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:55.436388 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:55.437099 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:55.437104 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:55.437225 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:55.437874 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:55.437894 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:55.441010 (+ 3116us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":389,"threads_started":1}
W20260812 00:21:55.441555 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:55.432195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:44165 (local address 127.18.163.254:36995)
0812 00:21:55.432405 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:55.432410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:55.432789 (+ 379us) server_negotiation.cc:407] Connection header received
0812 00:21:55.432934 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:55.432938 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:55.433004 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:55.433104 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:55.433959 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:55.434957 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:55.436512 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:55.436944 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:55.437044 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:55.441282 (+ 4238us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:44165: BlockingRecv error: recv got EOF from 127.18.163.193:44165 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 12 00:21:55 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:55 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:55.466615 29678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:55.456850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:46639)
0812 00:21:55.457417 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:55.457439 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:55.457666 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:55.458040 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:55.458045 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:55.458500 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:55.458704 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:55.458715 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:55.459935 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:55.459941 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:55.461228 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:55.461243 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:55.462078 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:55.462084 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:55.462273 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:55.462919 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:55.462938 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:55.466192 (+ 3254us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":381,"threads_started":1}
W20260812 00:21:55.466677 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:55.456928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:46639 (local address 127.18.163.254:36995)
0812 00:21:55.457226 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:55.457233 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:55.457544 (+ 311us) server_negotiation.cc:407] Connection header received
0812 00:21:55.457829 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:55.457833 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:55.457899 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:55.458003 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:55.458866 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:55.459745 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:55.461390 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:55.461911 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:55.462050 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:55.466428 (+ 4378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.195:46639: BlockingRecv error: recv got EOF from 127.18.163.195:46639 (error 108)
Metrics: {"server-negotiator.queue_time_us":116}
Aug 12 00:21:55 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:55 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:55.966800 29680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:55.957338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:54209)
0812 00:21:55.957997 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:55.958015 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:55.958181 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:55.958572 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:55.958576 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:55.958973 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:55.959132 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:55.959140 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:55.960201 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:55.960205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:55.961162 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:55.961174 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:55.962195 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:55.962202 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:55.962383 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:55.963153 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:55.963174 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:55.966549 (+ 3375us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":408,"threads_started":1}
W20260812 00:21:55.967391 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:55.957456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:54209 (local address 127.18.163.254:36995)
0812 00:21:55.957689 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:55.957694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:55.958107 (+ 413us) server_negotiation.cc:407] Connection header received
0812 00:21:55.958346 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:55.958350 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:55.958418 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:55.958504 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:55.959278 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:55.960038 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:55.961319 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:55.962004 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:55.962141 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:55.966785 (+ 4644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:54209: BlockingRecv error: recv got EOF from 127.18.163.194:54209 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 12 00:21:56 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:56 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:56.452136 29681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:56.442495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:55009)
0812 00:21:56.443328 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:56.443350 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:56.443520 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:56.443954 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:56.443957 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:56.444399 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:56.444639 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:56.444651 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:56.445968 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:56.445973 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:56.447033 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:56.447047 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:56.447866 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:56.447871 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:56.448008 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:56.448648 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:56.448667 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:56.451871 (+ 3204us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":697,"thread_start_us":549,"threads_started":1}
W20260812 00:21:56.452459 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:56.442796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:55009 (local address 127.18.163.254:36995)
0812 00:21:56.443025 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:56.443033 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:56.443478 (+ 445us) server_negotiation.cc:407] Connection header received
0812 00:21:56.443692 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:56.443698 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:56.443784 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:56.443913 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:56.444817 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:56.445808 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:56.447189 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:56.447708 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:56.447822 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:56.452123 (+ 4301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:55009: BlockingRecv error: recv got EOF from 127.18.163.193:55009 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 12 00:21:56 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:56 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:56.477116 29682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:56.467922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:50365)
0812 00:21:56.468790 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:56.468808 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:56.468988 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:56.469403 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:56.469407 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:56.469992 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:56.470199 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:56.470218 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:56.471356 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:56.471361 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:56.472418 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:56.472433 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:56.473150 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:56.473155 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:56.473280 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:56.473892 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:56.473910 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:56.476863 (+ 2953us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":432,"threads_started":1}
W20260812 00:21:56.477427 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:56.468181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:50365 (local address 127.18.163.254:36995)
0812 00:21:56.468730 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:56.468737 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:56.468911 (+ 174us) server_negotiation.cc:407] Connection header received
0812 00:21:56.469143 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:56.469147 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:56.469242 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:56.469352 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:56.470376 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:56.471163 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:56.472560 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:56.472985 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:56.473093 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:56.477106 (+ 4013us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.195:50365: BlockingRecv error: recv got EOF from 127.18.163.195:50365 (error 108)
Metrics: {"server-negotiator.queue_time_us":407}
Aug 12 00:21:56 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:56 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:56.977392 29683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:56.967865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:49529)
0812 00:21:56.968443 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:56.968459 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:56.968588 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:56.968919 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:56.968922 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:56.969395 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:56.969623 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:56.969634 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:56.970747 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:56.970751 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:56.971691 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:56.971704 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:56.972486 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:56.972491 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:56.972685 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:56.973431 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:56.973459 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:56.977122 (+ 3663us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":316,"threads_started":1}
W20260812 00:21:56.977885 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:56.968027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:49529 (local address 127.18.163.254:36995)
0812 00:21:56.968249 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:56.968254 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:56.968539 (+ 285us) server_negotiation.cc:407] Connection header received
0812 00:21:56.968694 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:56.968699 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:56.968767 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:56.968865 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:56.969771 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:56.970593 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:56.971845 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:56.972282 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:56.972388 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:56.977482 (+ 5094us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:49529: BlockingRecv error: recv got EOF from 127.18.163.194:49529 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 12 00:21:57 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:57 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:57.463176 29685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:57.453381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:36735)
0812 00:21:57.453952 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:57.453970 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:57.454110 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:57.454519 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:57.454522 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:57.454975 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:57.455150 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:57.455160 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:57.456349 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:57.456357 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:57.457617 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:57.457634 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:57.458548 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:57.458553 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:57.458842 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:57.459526 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:57.459547 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:57.462909 (+ 3362us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":346,"threads_started":1}
W20260812 00:21:57.463542 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:57.453492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:36735 (local address 127.18.163.254:36995)
0812 00:21:57.453820 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:57.453827 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:57.454067 (+ 240us) server_negotiation.cc:407] Connection header received
0812 00:21:57.454224 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:57.454228 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:57.454334 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:57.454447 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:57.455308 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:57.456164 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:57.457797 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:57.458376 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:57.458529 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:57.463211 (+ 4682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:36735: BlockingRecv error: recv got EOF from 127.18.163.193:36735 (error 108)
Metrics: {"server-negotiator.queue_time_us":118}
Aug 12 00:21:57 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:57 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:57.487946 29686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:57.478477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:42651)
0812 00:21:57.479048 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:57.479066 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:57.479199 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:57.479538 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:57.479542 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:57.480003 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:57.480191 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:57.480201 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:57.481238 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:57.481241 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:57.482356 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:57.482376 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:57.483424 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:57.483429 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:57.483621 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:57.484371 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:57.484393 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:57.487664 (+ 3271us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":316,"threads_started":1}
W20260812 00:21:57.488570 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:57.478591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:42651 (local address 127.18.163.254:36995)
0812 00:21:57.478807 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:57.478812 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:57.479154 (+ 342us) server_negotiation.cc:407] Connection header received
0812 00:21:57.479321 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:57.479325 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:57.479391 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:57.479490 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:57.480345 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:57.481100 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:57.482527 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:57.483239 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:57.483382 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:57.487945 (+ 4563us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.195:42651: BlockingRecv error: recv got EOF from 127.18.163.195:42651 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 12 00:21:57 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:57 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:57.988062 29687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:57.978869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:45067)
0812 00:21:57.979430 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:57.979447 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:57.979629 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:57.980056 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:57.980063 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:57.980534 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:57.980698 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:57.980707 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:57.981922 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:57.981926 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:57.983185 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:57.983203 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:57.983990 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:57.983994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:57.984133 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:57.984769 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:57.984788 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:57.987807 (+ 3019us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":331,"threads_started":1}
W20260812 00:21:57.988385 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:57.978902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:45067 (local address 127.18.163.254:36995)
0812 00:21:57.979184 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:57.979193 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:57.979548 (+ 355us) server_negotiation.cc:407] Connection header received
0812 00:21:57.979790 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:57.979796 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:57.979877 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:57.979991 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:57.980858 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:57.981760 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:57.983346 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:57.983837 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:57.983942 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:57.988072 (+ 4130us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:45067: BlockingRecv error: recv got EOF from 127.18.163.194:45067 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 12 00:21:58 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:58 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:58.474026 29688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:58.464354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:34167)
0812 00:21:58.465067 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:58.465087 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:58.465247 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:58.465673 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:58.465678 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:58.466226 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:58.466408 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:58.466418 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:58.467517 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:58.467523 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:58.468500 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:58.468516 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:58.469358 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:58.469364 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:58.469546 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:58.470300 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:58.470321 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:58.473725 (+ 3404us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":365,"threads_started":1}
W20260812 00:21:58.474294 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:58.464417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:34167 (local address 127.18.163.254:36995)
0812 00:21:58.464660 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:58.464668 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:58.465175 (+ 507us) server_negotiation.cc:407] Connection header received
0812 00:21:58.465381 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:58.465387 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:58.465466 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:58.465578 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:58.466573 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:58.467336 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:58.468698 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:58.469142 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:58.469300 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:58.473968 (+ 4668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:34167: BlockingRecv error: recv got EOF from 127.18.163.193:34167 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 12 00:21:58 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:58 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:58.498539 29690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:58.489238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:59043)
0812 00:21:58.489832 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:58.489855 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:58.490014 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:58.490454 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:58.490459 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:58.490947 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:58.491107 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:58.491117 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:58.492255 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:58.492268 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:58.493212 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:58.493226 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:58.494111 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:58.494117 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:58.494316 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:58.495019 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:58.495040 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:58.498176 (+ 3136us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":317,"threads_started":1}
W20260812 00:21:58.498759 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:58.489366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:59043 (local address 127.18.163.254:36995)
0812 00:21:58.489658 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:58.489666 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:58.489966 (+ 300us) server_negotiation.cc:407] Connection header received
0812 00:21:58.490178 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:58.490186 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:58.490300 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:58.490416 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:58.491279 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:58.492084 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:58.493406 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:58.493940 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:58.494089 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:58.498447 (+ 4358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.195:59043: BlockingRecv error: recv got EOF from 127.18.163.195:59043 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 12 00:21:58 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:58 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:58.999127 29691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:58.989254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:56223)
0812 00:21:58.989907 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:58.989924 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:58.990055 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:58.990383 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:58.990388 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:58.990966 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:58.991154 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:58.991164 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:58.992260 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:58.992264 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:58.993208 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:58.993219 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:58.994243 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:58.994248 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:58.994378 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:58.995138 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:58.995164 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:58.998846 (+ 3682us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":342,"threads_started":1}
W20260812 00:21:58.999496 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:58.989391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:56223 (local address 127.18.163.254:36995)
0812 00:21:58.989708 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:58.989713 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:58.990017 (+ 304us) server_negotiation.cc:407] Connection header received
0812 00:21:58.990167 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:58.990172 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:58.990240 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:58.990335 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:58.991323 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:58.992121 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:58.993360 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:58.993996 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:58.994111 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:58.999215 (+ 5104us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:56223: BlockingRecv error: recv got EOF from 127.18.163.194:56223 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 12 00:21:59 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:59 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:21:59.489140 29692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:59.475213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:54357)
0812 00:21:59.475827 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:59.475844 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:59.476025 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:59.476408 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:59.476412 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:59.476855 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:59.477048 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:59.477058 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:59.478303 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:59.478314 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:59.479269 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:59.479282 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:59.480082 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:59.480088 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:59.480286 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:59.485492 (+ 5206us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:59.485527 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:59.488855 (+ 3328us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":361,"threads_started":1}
W20260812 00:21:59.489449 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:59.475310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:54357 (local address 127.18.163.254:36995)
0812 00:21:59.475634 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:59.475641 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:59.475943 (+ 302us) server_negotiation.cc:407] Connection header received
0812 00:21:59.476176 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:59.476180 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:59.476248 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:59.476361 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:59.477216 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:59.478127 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:59.479443 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:59.479896 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:59.480052 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:59.489125 (+ 9073us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:54357: BlockingRecv error: recv got EOF from 127.18.163.193:54357 (error 108)
Metrics: {"server-negotiator.queue_time_us":121}
Aug 12 00:21:59 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:21:59 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:21:59.510592 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:21:59.499913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:45459 (local address 127.18.163.254:36995)
0812 00:21:59.500238 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0812 00:21:59.500259 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 00:21:59.500611 (+ 352us) server_negotiation.cc:407] Connection header received
0812 00:21:59.500858 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:21:59.500862 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:21:59.500929 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:21:59.501030 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:21:59.501966 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:59.502794 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:59.504096 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:21:59.504572 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:21:59.504723 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:59.510316 (+ 5593us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.195:45459: BlockingRecv error: recv got EOF from 127.18.163.195:45459 (error 108)
Metrics: {"server-negotiator.queue_time_us":166}
I20260812 00:21:59.511238 29694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:21:59.499803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:45459)
0812 00:21:59.500486 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0812 00:21:59.500504 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:21:59.500692 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:21:59.501062 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:21:59.501065 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:21:59.501489 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:21:59.501785 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:59.501798 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:59.502942 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:59.502947 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:59.503911 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:21:59.503923 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:21:59.504793 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:21:59.504797 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:21:59.504920 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:21:59.505725 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:21:59.505752 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:21:59.510837 (+ 5085us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":387,"threads_started":1}
Aug 12 00:22:00 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:22:00 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:22:00.012892 29696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:00.000261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:37049)
0812 00:22:00.000834 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:00.000850 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:00.001020 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:00.001380 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:00.001386 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:00.001928 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:22:00.002122 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:00.002133 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:00.003205 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:00.003211 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:00.004151 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:00.004165 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:00.005008 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:00.005014 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:00.005211 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:00.008844 (+ 3633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:22:00.008866 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:22:00.012608 (+ 3742us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":308,"threads_started":1}
W20260812 00:22:00.013144 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:22:00.000370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:37049 (local address 127.18.163.254:36995)
0812 00:22:00.000653 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:00.000660 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:00.000944 (+ 284us) server_negotiation.cc:407] Connection header received
0812 00:22:00.001146 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:00.001155 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:00.001225 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:00.001363 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:00.002298 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:00.003034 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:00.004330 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:00.004825 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:00.004976 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:00.012856 (+ 7880us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:37049: BlockingRecv error: recv got EOF from 127.18.163.194:37049 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 12 00:22:00 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:22:00 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.193@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:22:00.500455 29698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:00.490620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.193:45097)
0812 00:22:00.491245 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:00.491262 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:00.491398 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:00.491744 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:00.491747 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:00.492182 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:22:00.492364 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:00.492372 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:00.493707 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:00.493712 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:00.495115 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:00.495139 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:00.495892 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:00.495897 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:00.496027 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:00.496774 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:22:00.496794 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:22:00.500176 (+ 3382us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":339,"threads_started":1}
W20260812 00:22:00.500710 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:22:00.490703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:45097 (local address 127.18.163.254:36995)
0812 00:22:00.490914 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:00.490919 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:00.491349 (+ 430us) server_negotiation.cc:407] Connection header received
0812 00:22:00.491509 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:00.491514 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:00.491589 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:00.491689 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:00.492520 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:00.493488 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:00.495254 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:00.495711 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:00.495832 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:00.500435 (+ 4603us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.193:45097: BlockingRecv error: recv got EOF from 127.18.163.193:45097 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 12 00:22:00 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:22:00 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.195@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:22:00.522284 29699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:00.512528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.195:48023)
0812 00:22:00.513080 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:00.513099 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:00.513231 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:00.513709 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:00.513713 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:00.514148 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:22:00.514344 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:00.514353 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:00.515440 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:00.515444 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:00.516383 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:00.516394 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:00.517102 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:00.517107 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:00.517235 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:00.517967 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:22:00.517993 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:22:00.521996 (+ 4003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":312,"threads_started":1}
W20260812 00:22:00.522521 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:22:00.512667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:48023 (local address 127.18.163.254:36995)
0812 00:22:00.512863 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:00.512868 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:00.513184 (+ 316us) server_negotiation.cc:407] Connection header received
0812 00:22:00.513377 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:00.513383 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:00.513466 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:00.513632 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:00.514485 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:00.515276 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:00.516529 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:00.516960 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:00.517061 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:00.522233 (+ 5172us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.195:48023: BlockingRecv error: recv got EOF from 127.18.163.195:48023 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 12 00:22:01 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:22:01 dist-test-slave-njxd krb5kdc[28473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.163.194@KRBTEST.COM for oryx/127.18.163.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:22:01.024621 29700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:01.014226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:36995 (local address 127.18.163.194:55591)
0812 00:22:01.014953 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:01.014972 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:01.015106 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:01.015510 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:01.015517 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:01.016008 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:22:01.016349 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:01.016373 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:01.017568 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:01.017624 (+ 56us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:01.018670 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:01.018687 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:01.019600 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:01.019606 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:01.019817 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:01.020546 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:22:01.020567 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:22:01.024207 (+ 3640us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.163.254:36995: Server oryx/127.18.163.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":433,"threads_started":1}
W20260812 00:22:01.024749 29641 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:22:01.014360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:55591 (local address 127.18.163.254:36995)
0812 00:22:01.014619 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:01.014625 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:01.015065 (+ 440us) server_negotiation.cc:407] Connection header received
0812 00:22:01.015223 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:01.015227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:01.015297 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:01.015453 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:01.016579 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:01.017368 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:01.018881 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:01.019399 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:01.019586 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:01.024489 (+ 4903us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.163.194:55591: BlockingRecv error: recv got EOF from 127.18.163.194:55591 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 00:22:01.337776 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 29152
I20260812 00:22:01.352097 29702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:01.339236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39870 (local address 127.18.163.193:34639)
0812 00:22:01.339807 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:01.339816 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:01.339848 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:22:01.339924 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:01.339930 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:01.340167 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:01.340346 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:01.342119 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:01.343209 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:01.344650 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:01.345308 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:01.345423 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:01.348524 (+ 3101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:01.348535 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:01.348552 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:22:01.348599 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:01.351499 (+ 2900us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.163.193@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 00:22:01.351845 (+ 346us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39870: Request ticket server kudu/127.18.163.193@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":272,"threads_started":1}
W20260812 00:22:01.352218 29702 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39870: Request ticket server kudu/127.18.163.193@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 00:22:01.352612 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 29152: Not authorized: Client connection negotiation failed: client connection to 127.18.163.193:34639: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.163.193@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 00:22:01.352839 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 29152
I20260812 00:22:01.379082 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 29327
I20260812 00:22:01.393389 29703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:01.380332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54734 (local address 127.18.163.194:44851)
0812 00:22:01.381156 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:01.381164 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:01.381201 (+ 37us) server_negotiation.cc:407] Connection header received
0812 00:22:01.381272 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:01.381279 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:01.381518 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:01.381794 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:01.383248 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:01.384421 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:01.385909 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:01.386549 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:01.386675 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:01.389677 (+ 3002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:01.389690 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:01.389707 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:22:01.389752 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:01.392745 (+ 2993us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.163.194@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 00:22:01.393106 (+ 361us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54734: Request ticket server kudu/127.18.163.194@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":470,"threads_started":1}
W20260812 00:22:01.393553 29703 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54734: Request ticket server kudu/127.18.163.194@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 00:22:01.393687 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 29327: Not authorized: Client connection negotiation failed: client connection to 127.18.163.194:44851: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.163.194@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 00:22:01.393878 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 29327
I20260812 00:22:01.420258 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 29478
I20260812 00:22:01.435384 29704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:01.421446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57438 (local address 127.18.163.195:42393)
0812 00:22:01.422152 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:01.422160 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:01.422192 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:22:01.422259 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:01.422266 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:01.422527 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:01.422711 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:01.424676 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:01.426388 (+ 1712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:01.427799 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:01.428403 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:01.428568 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:01.431603 (+ 3035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:01.431619 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:01.431636 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:22:01.431693 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:01.434600 (+ 2907us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.163.195@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 00:22:01.435017 (+ 417us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57438: Request ticket server kudu/127.18.163.195@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":369,"threads_started":1}
W20260812 00:22:01.435557 29704 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57438: Request ticket server kudu/127.18.163.195@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 00:22:01.435647 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 29478: Not authorized: Client connection negotiation failed: client connection to 127.18.163.195:42393: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.163.195@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 00:22:01.435822 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 29478
I20260812 00:22:01.463825 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 29075
I20260812 00:22:01.465373 29143 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:22:01.595252 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 29075
2026-08-12T00:22:01Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22081 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T00:22:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:22:01Z Disabled control of system clock
I20260812 00:22:01.709429 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:32943
--webserver_interface=127.18.163.254
--webserver_port=0
--builtin_ntp_servers=127.18.163.212:41621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:32943
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 00:22:02.100168 29710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:22:02.100531 29710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:22:02.100618 29710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:22:02.108443 29710 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:22:02.108588 29710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:22:02.108628 29710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:22:02.108688 29710 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:22:02.108741 29710 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:22:02.118811 29710 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:41621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:32943
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:32943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:22:02.120272 29710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:22:02.122278 29710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:22:02.136808 29717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:02.136794 29722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:02.136759 29719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:22:02.137624 29710 server_base.cc:1034] running on GCE node
I20260812 00:22:02.138613 29710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:22:02.140398 29710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:22:02.141748 29710 hybrid_clock.cc:648] HybridClock initialized: now 1786494122141688 us; error 68 us; skew 500 ppm
I20260812 00:22:02.142203 29710 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:22:02.145133 29710 webserver.cc:460] Webserver started at http://127.18.163.254:35149/ using document root <none> and password file <none>
I20260812 00:22:02.146068 29710 fs_manager.cc:359] Metadata directory not provided
I20260812 00:22:02.146237 29710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:22:02.146800 29710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:22:02.150525 29710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "a100feb752db4c95831d3cc8eb17ef37"
format_stamp: "Formatted at 2026-08-12 00:22:02 on dist-test-slave-njxd"
server_key: "3ed3be290c5dc60ebeced3d83e8766cf"
server_key_iv: "007266f21522602281d355c1a3232fba"
server_key_version: "encryptionkey@0"
I20260812 00:22:02.151546 29710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "a100feb752db4c95831d3cc8eb17ef37"
format_stamp: "Formatted at 2026-08-12 00:22:02 on dist-test-slave-njxd"
server_key: "3ed3be290c5dc60ebeced3d83e8766cf"
server_key_iv: "007266f21522602281d355c1a3232fba"
server_key_version: "encryptionkey@0"
I20260812 00:22:02.158017 29710 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:22:02.162283 29729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:02.164018 29710 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 00:22:02.164279 29710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "a100feb752db4c95831d3cc8eb17ef37"
format_stamp: "Formatted at 2026-08-12 00:22:02 on dist-test-slave-njxd"
server_key: "3ed3be290c5dc60ebeced3d83e8766cf"
server_key_iv: "007266f21522602281d355c1a3232fba"
server_key_version: "encryptionkey@0"
I20260812 00:22:02.164564 29710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:22:02.204772 29710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:22:02.205981 29710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:22:02.206390 29710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:22:02.228972 29710 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:32943
I20260812 00:22:02.229007 29790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:32943 every 8 connection(s)
I20260812 00:22:02.230679 29710 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:22:02.235095 29791 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:22:02.237322 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 29710
I20260812 00:22:02.237610 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:22:02.238495 19087 external_mini_cluster.cc:1428] Setting key 14f994032677ec2494e4f9f214ad4ce5
I20260812 00:22:02.250070 29791 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37: Bootstrap starting.
I20260812 00:22:02.254529 29791 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37: Neither blocks nor log segments found. Creating new log.
I20260812 00:22:02.255963 29791 log.cc:824] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37: Log is configured to *not* fsync() on all Append() calls
I20260812 00:22:02.256697 29794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:02.241917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42012 (local address 127.18.163.254:32943)
0812 00:22:02.243364 (+ 1447us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:02.243383 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:02.243438 (+ 55us) server_negotiation.cc:407] Connection header received
0812 00:22:02.245325 (+ 1887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:02.245353 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:02.246055 (+ 702us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:02.246482 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:02.247333 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:02.248757 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:02.250875 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:02.251702 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:02.251901 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:02.253771 (+ 1870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:02.253781 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:02.253799 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:22:02.254437 (+ 638us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:02.254535 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:22:02.254576 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:02.254756 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:02.255061 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 00:22:02.255435 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":902,"thread_start_us":526,"threads_started":1}
I20260812 00:22:02.259676 29791 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37: No bootstrap required, opened a new log
I20260812 00:22:02.268227 29791 raft_consensus.cc:348] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a100feb752db4c95831d3cc8eb17ef37" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 32943 } }
I20260812 00:22:02.268777 29791 raft_consensus.cc:374] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:22:02.268963 29791 raft_consensus.cc:729] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a100feb752db4c95831d3cc8eb17ef37, State: Initialized, Role: FOLLOWER
I20260812 00:22:02.269788 29791 consensus_queue.cc:260] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a100feb752db4c95831d3cc8eb17ef37" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 32943 } }
I20260812 00:22:02.270028 29791 raft_consensus.cc:388] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:22:02.270202 29791 raft_consensus.cc:482] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:22:02.270407 29791 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:22:02.273516 29791 raft_consensus.cc:504] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a100feb752db4c95831d3cc8eb17ef37" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 32943 } }
I20260812 00:22:02.274382 29791 leader_election.cc:302] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a100feb752db4c95831d3cc8eb17ef37; no voters:
I20260812 00:22:02.275271 29791 leader_election.cc:288] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:22:02.275416 29796 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:22:02.276868 29796 raft_consensus.cc:686] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [term 1 LEADER]: Becoming Leader. State: Replica: a100feb752db4c95831d3cc8eb17ef37, State: Running, Role: LEADER
I20260812 00:22:02.277621 29796 consensus_queue.cc:237] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a100feb752db4c95831d3cc8eb17ef37" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 32943 } }
I20260812 00:22:02.278298 29791 sys_catalog.cc:564] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:22:02.281317 29797 sys_catalog.cc:455] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a100feb752db4c95831d3cc8eb17ef37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a100feb752db4c95831d3cc8eb17ef37" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 32943 } } }
I20260812 00:22:02.281817 29797 sys_catalog.cc:458] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [sys.catalog]: This master's current role is: LEADER
I20260812 00:22:02.281536 29798 sys_catalog.cc:455] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a100feb752db4c95831d3cc8eb17ef37. Latest consensus state: current_term: 1 leader_uuid: "a100feb752db4c95831d3cc8eb17ef37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a100feb752db4c95831d3cc8eb17ef37" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 32943 } } }
I20260812 00:22:02.282020 29798 sys_catalog.cc:458] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37 [sys.catalog]: This master's current role is: LEADER
I20260812 00:22:02.284520 29805 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:22:02.291003 29805 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:22:02.302178 29805 catalog_manager.cc:1347] Generated new cluster ID: 71298e40b807424c9448ab42108aa4fd
I20260812 00:22:02.302353 29805 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:22:02.325934 29805 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:22:02.327400 29805 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:22:02.335199 29805 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a100feb752db4c95831d3cc8eb17ef37: Generated new TSK 0
I20260812 00:22:02.336418 29805 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:22:02.348914 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:32943
--builtin_ntp_servers=127.18.163.212:41621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 00:22:02.744029 29816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:22:02.744417 29816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:22:02.744583 29816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:22:02.753322 29816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:22:02.753484 29816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:22:02.753715 29816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:22:02.764057 29816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:41621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:32943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:22:02.765712 29816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:22:02.767855 29816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:22:02.785427 29822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:22:02.785732 29816 server_base.cc:1034] running on GCE node
W20260812 00:22:02.785392 29825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:02.785346 29823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:22:02.786780 29816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:22:02.787974 29816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:22:02.789242 29816 hybrid_clock.cc:648] HybridClock initialized: now 1786494122789164 us; error 47 us; skew 500 ppm
I20260812 00:22:02.789772 29816 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:22:02.793272 29816 webserver.cc:460] Webserver started at http://127.18.163.193:42909/ using document root <none> and password file <none>
I20260812 00:22:02.794219 29816 fs_manager.cc:359] Metadata directory not provided
I20260812 00:22:02.794371 29816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:22:02.794793 29816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:22:02.798295 29816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "88a053e0844547c7bfde148bf9a923c5"
format_stamp: "Formatted at 2026-08-12 00:22:02 on dist-test-slave-njxd"
server_key: "18efb61a2b8dadd327a7634091be675a"
server_key_iv: "9fc76eaa7ce2b534b660f7092276f7b1"
server_key_version: "encryptionkey@0"
I20260812 00:22:02.799319 29816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "88a053e0844547c7bfde148bf9a923c5"
format_stamp: "Formatted at 2026-08-12 00:22:02 on dist-test-slave-njxd"
server_key: "18efb61a2b8dadd327a7634091be675a"
server_key_iv: "9fc76eaa7ce2b534b660f7092276f7b1"
server_key_version: "encryptionkey@0"
I20260812 00:22:02.805830 29816 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260812 00:22:02.810204 29832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:02.811942 29816 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 00:22:02.812197 29816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "88a053e0844547c7bfde148bf9a923c5"
format_stamp: "Formatted at 2026-08-12 00:22:02 on dist-test-slave-njxd"
server_key: "18efb61a2b8dadd327a7634091be675a"
server_key_iv: "9fc76eaa7ce2b534b660f7092276f7b1"
server_key_version: "encryptionkey@0"
I20260812 00:22:02.812490 29816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:22:02.848320 29816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:22:02.849370 29816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:22:02.849848 29816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:22:02.850975 29816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:22:02.852730 29816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:22:02.852869 29816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:02.853042 29816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:22:02.853144 29816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:02.890295 29816 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:44049
I20260812 00:22:02.890401 29960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:44049 every 8 connection(s)
I20260812 00:22:02.891800 29816 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:22:02.895809 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 29816
I20260812 00:22:02.896065 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:22:02.897042 19087 external_mini_cluster.cc:1428] Setting key 32c59c3001a787f90d8d496abb944d70
I20260812 00:22:02.900277 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:32943
--builtin_ntp_servers=127.18.163.212:41621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 00:22:02.907655 29963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:02.895266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:40663 (local address 127.18.163.254:32943)
0812 00:22:02.895870 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:02.895876 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:02.897760 (+ 1884us) server_negotiation.cc:407] Connection header received
0812 00:22:02.900062 (+ 2302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:02.900068 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:02.900166 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:02.900305 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:02.901688 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:02.902457 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:02.904304 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:02.904759 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:02.904916 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:02.906644 (+ 1728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:02.906650 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:02.906653 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:22:02.906677 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:02.906729 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:22:02.906743 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:02.906851 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:02.907135 (+ 284us) server_negotiation.cc:299] Negotiation successful
0812 00:22:02.907263 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":335,"threads_started":1}
I20260812 00:22:02.908947 29964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:02.896191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:32943 (local address 127.18.163.193:40663)
0812 00:22:02.897485 (+ 1294us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:02.897551 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:02.899742 (+ 2191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:02.900630 (+ 888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:02.900641 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:02.900753 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:22:02.901445 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:02.901465 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:02.902686 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:02.902690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:02.904094 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:02.904112 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:02.905053 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:02.905065 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:02.905330 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:02.906222 (+ 892us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:22:02.906225 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:22:02.906274 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:22:02.906377 (+ 103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:22:02.906855 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:22:02.906872 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:22:02.906883 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:22:02.907097 (+ 214us) client_negotiation.cc:240] Negotiation successful
0812 00:22:02.907612 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"thread_start_us":379,"threads_started":1}
I20260812 00:22:02.910910 29961 heartbeater.cc:347] Connected to a master server at 127.18.163.254:32943
I20260812 00:22:02.911314 29961 heartbeater.cc:464] Registering TS with master...
I20260812 00:22:02.912254 29961 heartbeater.cc:511] Master 127.18.163.254:32943 requested a full tablet report, sending...
I20260812 00:22:02.914908 29751 ts_manager.cc:194] Registered new tserver with Master: 88a053e0844547c7bfde148bf9a923c5 (127.18.163.193:44049)
I20260812 00:22:02.916572 29751 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.163.193:40663
W20260812 00:22:03.279728 29965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:22:03.280052 29965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:22:03.280143 29965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:22:03.287984 29965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:22:03.288106 29965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:22:03.288228 29965 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:22:03.297960 29965 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:41621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:32943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:22:03.299360 29965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:22:03.301319 29965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:22:03.315892 29971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:03.315936 29975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:03.315979 29972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:22:03.316843 29965 server_base.cc:1034] running on GCE node
I20260812 00:22:03.317763 29965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:22:03.318908 29965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:22:03.320158 29965 hybrid_clock.cc:648] HybridClock initialized: now 1786494123320084 us; error 72 us; skew 500 ppm
I20260812 00:22:03.320525 29965 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:22:03.323122 29965 webserver.cc:460] Webserver started at http://127.18.163.194:43871/ using document root <none> and password file <none>
I20260812 00:22:03.323945 29965 fs_manager.cc:359] Metadata directory not provided
I20260812 00:22:03.324098 29965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:22:03.324467 29965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:22:03.327766 29965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "57d6ed7f96f54fcb9e5531434d2aebdd"
format_stamp: "Formatted at 2026-08-12 00:22:03 on dist-test-slave-njxd"
server_key: "edb0854b7839e2dafc6b1fa3c1e47cf6"
server_key_iv: "eca5c7bcb9762abd64b506fa8888dd4b"
server_key_version: "encryptionkey@0"
I20260812 00:22:03.328723 29965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "57d6ed7f96f54fcb9e5531434d2aebdd"
format_stamp: "Formatted at 2026-08-12 00:22:03 on dist-test-slave-njxd"
server_key: "edb0854b7839e2dafc6b1fa3c1e47cf6"
server_key_iv: "eca5c7bcb9762abd64b506fa8888dd4b"
server_key_version: "encryptionkey@0"
I20260812 00:22:03.334786 29965 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 00:22:03.338869 29985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:03.340415 29965 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:22:03.340637 29965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "57d6ed7f96f54fcb9e5531434d2aebdd"
format_stamp: "Formatted at 2026-08-12 00:22:03 on dist-test-slave-njxd"
server_key: "edb0854b7839e2dafc6b1fa3c1e47cf6"
server_key_iv: "eca5c7bcb9762abd64b506fa8888dd4b"
server_key_version: "encryptionkey@0"
I20260812 00:22:03.340905 29965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:22:03.366596 29965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:22:03.367594 29965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:22:03.367942 29965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:22:03.369195 29965 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:22:03.371174 29965 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:22:03.371311 29965 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:03.371430 29965 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:22:03.371548 29965 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:03.408387 29965 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:44515
I20260812 00:22:03.408440 30112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:44515 every 8 connection(s)
I20260812 00:22:03.409947 29965 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:22:03.419906 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 29965
I20260812 00:22:03.420126 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:22:03.420611 19087 external_mini_cluster.cc:1428] Setting key c79aaf615213c8f0d6413589ebce56dc
I20260812 00:22:03.423686 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:32943
--builtin_ntp_servers=127.18.163.212:41621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 00:22:03.424268 30115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:03.412836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:53701 (local address 127.18.163.254:32943)
0812 00:22:03.413345 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:03.413352 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:03.414791 (+ 1439us) server_negotiation.cc:407] Connection header received
0812 00:22:03.416882 (+ 2091us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:03.416887 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:03.416995 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:03.417113 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:03.418438 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:03.419193 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:03.421073 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:03.421639 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:03.421781 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:03.423334 (+ 1553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:03.423339 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:03.423342 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:22:03.423362 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:03.423405 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:22:03.423418 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:03.423519 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:03.423772 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 00:22:03.423891 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":235,"threads_started":1}
I20260812 00:22:03.425500 30116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:03.413505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:32943 (local address 127.18.163.194:53701)
0812 00:22:03.414585 (+ 1080us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:03.414652 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:03.416560 (+ 1908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:03.417347 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:03.417357 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:03.417498 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:22:03.418250 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:03.418270 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:03.419378 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:03.419382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:03.420905 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:03.420919 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:03.421916 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:03.421927 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:03.422170 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:03.422947 (+ 777us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:22:03.422950 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:22:03.422996 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:22:03.423093 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:22:03.423522 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:22:03.423538 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:22:03.423549 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:22:03.423755 (+ 206us) client_negotiation.cc:240] Negotiation successful
0812 00:22:03.424240 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":309,"threads_started":1}
I20260812 00:22:03.427515 30113 heartbeater.cc:347] Connected to a master server at 127.18.163.254:32943
I20260812 00:22:03.427922 30113 heartbeater.cc:464] Registering TS with master...
I20260812 00:22:03.428900 30113 heartbeater.cc:511] Master 127.18.163.254:32943 requested a full tablet report, sending...
I20260812 00:22:03.430863 29751 ts_manager.cc:194] Registered new tserver with Master: 57d6ed7f96f54fcb9e5531434d2aebdd (127.18.163.194:44515)
I20260812 00:22:03.432184 29751 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.163.194:53701
W20260812 00:22:03.798765 30118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:22:03.799080 30118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:22:03.799175 30118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:22:03.807646 30118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:22:03.807771 30118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:22:03.807885 30118 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:22:03.817739 30118 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:41621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:32943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:22:03.819128 30118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:22:03.821097 30118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:22:03.836333 30124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:03.836306 30126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:03.836306 30123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:22:03.839433 30118 server_base.cc:1034] running on GCE node
I20260812 00:22:03.840197 30118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:22:03.841325 30118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:22:03.842589 30118 hybrid_clock.cc:648] HybridClock initialized: now 1786494123842523 us; error 64 us; skew 500 ppm
I20260812 00:22:03.842967 30118 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:22:03.845805 30118 webserver.cc:460] Webserver started at http://127.18.163.195:40407/ using document root <none> and password file <none>
I20260812 00:22:03.846607 30118 fs_manager.cc:359] Metadata directory not provided
I20260812 00:22:03.846755 30118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:22:03.847123 30118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:22:03.853708 30118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "34e25563da5b4326936f88b8d77931a2"
format_stamp: "Formatted at 2026-08-12 00:22:03 on dist-test-slave-njxd"
server_key: "0f336a887ad62b94aaf973ef951de8d8"
server_key_iv: "38dae8c51a68d4b9144ffb371fb7e311"
server_key_version: "encryptionkey@0"
I20260812 00:22:03.854698 30118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "34e25563da5b4326936f88b8d77931a2"
format_stamp: "Formatted at 2026-08-12 00:22:03 on dist-test-slave-njxd"
server_key: "0f336a887ad62b94aaf973ef951de8d8"
server_key_iv: "38dae8c51a68d4b9144ffb371fb7e311"
server_key_version: "encryptionkey@0"
I20260812 00:22:03.860719 30118 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260812 00:22:03.864857 30132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:03.866540 30118 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:22:03.866778 30118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "34e25563da5b4326936f88b8d77931a2"
format_stamp: "Formatted at 2026-08-12 00:22:03 on dist-test-slave-njxd"
server_key: "0f336a887ad62b94aaf973ef951de8d8"
server_key_iv: "38dae8c51a68d4b9144ffb371fb7e311"
server_key_version: "encryptionkey@0"
I20260812 00:22:03.867055 30118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:22:03.898769 30118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:22:03.899827 30118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:22:03.900192 30118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:22:03.901321 30118 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:22:03.903137 30118 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:22:03.903272 30118 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:03.903429 30118 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:22:03.903522 30118 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:03.921229 29961 heartbeater.cc:503] Master 127.18.163.254:32943 was elected leader, sending a full tablet report...
I20260812 00:22:03.941084 30118 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:42859
I20260812 00:22:03.941191 30264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:42859 every 8 connection(s)
I20260812 00:22:03.942678 30118 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:22:03.943060 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 30118
I20260812 00:22:03.943298 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:22:03.943964 19087 external_mini_cluster.cc:1428] Setting key 251940a250fc01be80d359c5bf37c2f2
I20260812 00:22:03.957221 30267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:03.945800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:36929 (local address 127.18.163.254:32943)
0812 00:22:03.946350 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:03.946358 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:03.947891 (+ 1533us) server_negotiation.cc:407] Connection header received
0812 00:22:03.949855 (+ 1964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:03.949861 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:03.949960 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:03.950083 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:03.951265 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:03.952229 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:03.954055 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:03.954467 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:03.954656 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:03.956228 (+ 1572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:03.956234 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:03.956237 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:22:03.956260 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:03.956304 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:22:03.956316 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:03.956421 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:03.956671 (+ 250us) server_negotiation.cc:299] Negotiation successful
0812 00:22:03.956790 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":288,"threads_started":1}
I20260812 00:22:03.958423 30268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:03.946684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:32943 (local address 127.18.163.195:36929)
0812 00:22:03.947741 (+ 1057us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:03.947782 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:03.949507 (+ 1725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:03.950356 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:03.950366 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:03.950464 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:22:03.951083 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:03.951102 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:03.952407 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:03.952413 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:03.953891 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:03.953906 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:03.954757 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:03.954767 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:03.955041 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:03.955845 (+ 804us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:22:03.955848 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:22:03.955895 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:22:03.955986 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:22:03.956422 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:22:03.956438 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:22:03.956448 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 00:22:03.956660 (+ 212us) client_negotiation.cc:240] Negotiation successful
0812 00:22:03.957140 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":375,"threads_started":1}
I20260812 00:22:03.960016 30265 heartbeater.cc:347] Connected to a master server at 127.18.163.254:32943
I20260812 00:22:03.960379 30265 heartbeater.cc:464] Registering TS with master...
I20260812 00:22:03.961239 30265 heartbeater.cc:511] Master 127.18.163.254:32943 requested a full tablet report, sending...
I20260812 00:22:03.963009 29751 ts_manager.cc:194] Registered new tserver with Master: 34e25563da5b4326936f88b8d77931a2 (127.18.163.195:42859)
I20260812 00:22:03.963905 29751 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.163.195:36929
I20260812 00:22:03.973242 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 00:22:03.980611 30267 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:22:03.978733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42014 (local address 127.18.163.254:32943)
0812 00:22:03.978978 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:03.978986 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:03.979604 (+ 618us) server_negotiation.cc:407] Connection header received
0812 00:22:03.979831 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:03.979835 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:03.979906 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:03.980006 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:03.980405 (+ 399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42014: BlockingRecv error: recv got EOF from 127.0.0.1:42014 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 00:22:03.981540 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 29816
I20260812 00:22:03.990046 30276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:03.982591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50632 (local address 127.18.163.193:44049)
0812 00:22:03.983191 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:03.983199 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:03.983227 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:22:03.983295 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:03.983302 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:03.983535 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:03.983670 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:03.984085 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:03.985187 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:03.986659 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:03.987295 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:03.987409 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:03.988501 (+ 1092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:03.988512 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:03.988526 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:22:03.989167 (+ 641us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:03.989221 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:22:03.989242 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:03.989350 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:03.989554 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 00:22:03.989736 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":274,"threads_started":1}
I20260812 00:22:03.991403 29956 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:22:04.079762 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 29816
I20260812 00:22:04.102705 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 29965
I20260812 00:22:04.111279 30279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:04.103716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33052 (local address 127.18.163.194:44515)
0812 00:22:04.104251 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:04.104258 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:04.104289 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:22:04.104351 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:04.104358 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:04.104613 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:04.104799 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:04.105250 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:04.106365 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:04.107644 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:04.108248 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:04.108403 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:04.109620 (+ 1217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:04.109634 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:04.109656 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:22:04.110352 (+ 696us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:04.110403 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:22:04.110424 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:04.110561 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:04.110746 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 00:22:04.110913 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":269,"threads_started":1}
I20260812 00:22:04.112638 30107 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:22:04.199666 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 29965
I20260812 00:22:04.221920 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 30118
I20260812 00:22:04.231185 30281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:04.223110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37364 (local address 127.18.163.195:42859)
0812 00:22:04.223861 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:04.223869 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:04.223901 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:22:04.223968 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:04.223975 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:04.224199 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:04.224352 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:04.224803 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:04.225970 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:04.227299 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:04.227900 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:04.228013 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:04.229280 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:04.229291 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:04.229306 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:22:04.230145 (+ 839us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:04.230240 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:22:04.230274 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:04.230409 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:04.230612 (+ 203us) server_negotiation.cc:299] Negotiation successful
0812 00:22:04.230750 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":424,"threads_started":1}
I20260812 00:22:04.232537 30260 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:22:04.319614 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 30118
I20260812 00:22:04.341132 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 29710
I20260812 00:22:04.342530 29785 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:22:04.452816 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 29710
2026-08-12T00:22:04Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2847 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T00:22:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:22:04Z Disabled control of system clock
I20260812 00:22:04.553508 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:37533
--webserver_interface=127.18.163.254
--webserver_port=0
--builtin_ntp_servers=127.18.163.212:36659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:37533
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 00:22:04.930933 30288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:22:04.931293 30288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:22:04.931383 30288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:22:04.939282 30288 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:22:04.939428 30288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:22:04.939471 30288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:22:04.939529 30288 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:22:04.939582 30288 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:22:04.949451 30288 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:37533
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:37533
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:22:04.950888 30288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:22:04.952778 30288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:22:04.965685 30294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:04.965637 30298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:04.965636 30295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:22:04.966636 30288 server_base.cc:1034] running on GCE node
I20260812 00:22:04.967634 30288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:22:04.969174 30288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:22:04.970382 30288 hybrid_clock.cc:648] HybridClock initialized: now 1786494124970320 us; error 59 us; skew 500 ppm
I20260812 00:22:04.970819 30288 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:22:04.973271 30288 webserver.cc:460] Webserver started at http://127.18.163.254:35185/ using document root <none> and password file <none>
I20260812 00:22:04.974133 30288 fs_manager.cc:359] Metadata directory not provided
I20260812 00:22:04.974267 30288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:22:04.974915 30288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:22:04.978582 30288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "8a4d6798638e4bb799ddcbeb21e119b2"
format_stamp: "Formatted at 2026-08-12 00:22:04 on dist-test-slave-njxd"
server_key: "5d69413ff08ff1bc7182904a46e927e6"
server_key_iv: "0c69bf04a8d3783205b550f313dfd5f0"
server_key_version: "encryptionkey@0"
I20260812 00:22:04.979537 30288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "8a4d6798638e4bb799ddcbeb21e119b2"
format_stamp: "Formatted at 2026-08-12 00:22:04 on dist-test-slave-njxd"
server_key: "5d69413ff08ff1bc7182904a46e927e6"
server_key_iv: "0c69bf04a8d3783205b550f313dfd5f0"
server_key_version: "encryptionkey@0"
I20260812 00:22:04.985904 30288 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 00:22:04.990118 30307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:04.991869 30288 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:22:04.992123 30288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "8a4d6798638e4bb799ddcbeb21e119b2"
format_stamp: "Formatted at 2026-08-12 00:22:04 on dist-test-slave-njxd"
server_key: "5d69413ff08ff1bc7182904a46e927e6"
server_key_iv: "0c69bf04a8d3783205b550f313dfd5f0"
server_key_version: "encryptionkey@0"
I20260812 00:22:04.992400 30288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:22:04.999140 30288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:22:05.000105 30288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:22:05.000470 30288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:22:05.021215 30288 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:37533
I20260812 00:22:05.021224 30362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:37533 every 8 connection(s)
I20260812 00:22:05.022869 30288 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:22:05.027079 30363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:22:05.028767 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 30288
I20260812 00:22:05.028980 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:22:05.029772 19087 external_mini_cluster.cc:1428] Setting key 77436b15daa5db965ba8ba606cc30dcc
I20260812 00:22:05.040014 30363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2: Bootstrap starting.
I20260812 00:22:05.043774 30363 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2: Neither blocks nor log segments found. Creating new log.
I20260812 00:22:05.044799 30368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:05.032183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59408 (local address 127.18.163.254:37533)
0812 00:22:05.033488 (+ 1305us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:05.033501 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:05.033557 (+ 56us) server_negotiation.cc:407] Connection header received
0812 00:22:05.035378 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:05.035405 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:05.035883 (+ 478us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:05.036249 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:05.042836 (+ 6587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:05.042844 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:05.042860 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:22:05.042883 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:05.042956 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:22:05.042975 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:05.043211 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:05.043368 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 00:22:05.043677 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":809,"thread_start_us":537,"threads_started":1}
I20260812 00:22:05.045068 30363 log.cc:824] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2: Log is configured to *not* fsync() on all Append() calls
I20260812 00:22:05.048493 30363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2: No bootstrap required, opened a new log
I20260812 00:22:05.056519 30363 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4d6798638e4bb799ddcbeb21e119b2" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37533 } }
I20260812 00:22:05.057057 30363 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:22:05.057171 30363 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a4d6798638e4bb799ddcbeb21e119b2, State: Initialized, Role: FOLLOWER
I20260812 00:22:05.057875 30363 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4d6798638e4bb799ddcbeb21e119b2" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37533 } }
I20260812 00:22:05.058146 30363 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:22:05.058328 30363 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:22:05.058514 30363 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:22:05.060892 30363 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4d6798638e4bb799ddcbeb21e119b2" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37533 } }
I20260812 00:22:05.061499 30363 leader_election.cc:302] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a4d6798638e4bb799ddcbeb21e119b2; no voters:
I20260812 00:22:05.062280 30363 leader_election.cc:288] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:22:05.062438 30371 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:22:05.063305 30371 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [term 1 LEADER]: Becoming Leader. State: Replica: 8a4d6798638e4bb799ddcbeb21e119b2, State: Running, Role: LEADER
I20260812 00:22:05.063952 30371 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4d6798638e4bb799ddcbeb21e119b2" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37533 } }
I20260812 00:22:05.064842 30363 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:22:05.067826 30373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a4d6798638e4bb799ddcbeb21e119b2. Latest consensus state: current_term: 1 leader_uuid: "8a4d6798638e4bb799ddcbeb21e119b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4d6798638e4bb799ddcbeb21e119b2" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37533 } } }
I20260812 00:22:05.067821 30372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a4d6798638e4bb799ddcbeb21e119b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4d6798638e4bb799ddcbeb21e119b2" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37533 } } }
I20260812 00:22:05.068342 30373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [sys.catalog]: This master's current role is: LEADER
I20260812 00:22:05.068378 30372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2 [sys.catalog]: This master's current role is: LEADER
I20260812 00:22:05.071853 30378 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:22:05.079674 30378 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:22:05.092608 30378 catalog_manager.cc:1347] Generated new cluster ID: 17ca994f768a42f1b45f515edbe4d110
I20260812 00:22:05.092751 30378 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:22:05.123971 30378 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:22:05.124517 30378 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:22:05.140575 30378 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a4d6798638e4bb799ddcbeb21e119b2: Generated new TSK 0
I20260812 00:22:05.141888 30378 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:22:05.159948 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37533
--builtin_ntp_servers=127.18.163.212:36659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 00:22:05.550829 30395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:22:05.551156 30395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:22:05.551330 30395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:22:05.559213 30395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:22:05.559350 30395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:22:05.559548 30395 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:22:05.570216 30395 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37533
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:22:05.571770 30395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:22:05.574025 30395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:22:05.589176 30400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:05.589289 30401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:05.589377 30403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:22:05.590454 30395 server_base.cc:1034] running on GCE node
I20260812 00:22:05.591171 30395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:22:05.592267 30395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:22:05.593488 30395 hybrid_clock.cc:648] HybridClock initialized: now 1786494125593435 us; error 42 us; skew 500 ppm
I20260812 00:22:05.593930 30395 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:22:05.596676 30395 webserver.cc:460] Webserver started at http://127.18.163.193:45327/ using document root <none> and password file <none>
I20260812 00:22:05.597654 30395 fs_manager.cc:359] Metadata directory not provided
I20260812 00:22:05.597815 30395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:22:05.598217 30395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:22:05.601686 30395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "2655d1a63e33409ab57074f88e7481b6"
format_stamp: "Formatted at 2026-08-12 00:22:05 on dist-test-slave-njxd"
server_key: "81744bb47dde68df18d252d77b205bd3"
server_key_iv: "e6cd07d70fa7e1179c2da61a848acded"
server_key_version: "encryptionkey@0"
I20260812 00:22:05.602662 30395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "2655d1a63e33409ab57074f88e7481b6"
format_stamp: "Formatted at 2026-08-12 00:22:05 on dist-test-slave-njxd"
server_key: "81744bb47dde68df18d252d77b205bd3"
server_key_iv: "e6cd07d70fa7e1179c2da61a848acded"
server_key_version: "encryptionkey@0"
I20260812 00:22:05.608729 30395 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260812 00:22:05.612910 30411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:05.614809 30395 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:22:05.615031 30395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "2655d1a63e33409ab57074f88e7481b6"
format_stamp: "Formatted at 2026-08-12 00:22:05 on dist-test-slave-njxd"
server_key: "81744bb47dde68df18d252d77b205bd3"
server_key_iv: "e6cd07d70fa7e1179c2da61a848acded"
server_key_version: "encryptionkey@0"
I20260812 00:22:05.615314 30395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:22:05.622033 30395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:22:05.623047 30395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:22:05.623363 30395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:22:05.624476 30395 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:22:05.626312 30395 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:22:05.626413 30395 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:05.626600 30395 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:22:05.626703 30395 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:05.663511 30395 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:36507
I20260812 00:22:05.663631 30541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:36507 every 8 connection(s)
I20260812 00:22:05.665078 30395 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:22:05.666119 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 30395
I20260812 00:22:05.666347 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:22:05.667183 19087 external_mini_cluster.cc:1428] Setting key ab5e619e57f442f532f878fd510a71f9
I20260812 00:22:05.670838 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37533
--builtin_ntp_servers=127.18.163.212:36659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 00:22:05.676230 30544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:05.668307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:50905 (local address 127.18.163.254:37533)
0812 00:22:05.668835 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:05.668841 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:05.670521 (+ 1680us) server_negotiation.cc:407] Connection header received
0812 00:22:05.673495 (+ 2974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:05.673500 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:05.673562 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:05.673722 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:05.675480 (+ 1758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:05.675484 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:05.675488 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:22:05.675507 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:05.675552 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:22:05.675564 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:05.675675 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:05.675907 (+ 232us) server_negotiation.cc:299] Negotiation successful
0812 00:22:05.675965 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":273,"threads_started":1}
I20260812 00:22:05.677793 30545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:05.669016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:37533 (local address 127.18.163.193:50905)
0812 00:22:05.670325 (+ 1309us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:05.670381 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:05.673122 (+ 2741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:05.674060 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:05.674077 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:05.674224 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:22:05.675069 (+ 845us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:22:05.675075 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:22:05.675135 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:22:05.675271 (+ 136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:22:05.675670 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:22:05.675683 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:22:05.675694 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:22:05.676005 (+ 311us) client_negotiation.cc:240] Negotiation successful
0812 00:22:05.676313 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":662,"thread_start_us":377,"threads_started":1}
I20260812 00:22:05.679654 30542 heartbeater.cc:347] Connected to a master server at 127.18.163.254:37533
I20260812 00:22:05.680051 30542 heartbeater.cc:464] Registering TS with master...
I20260812 00:22:05.680730 30542 heartbeater.cc:511] Master 127.18.163.254:37533 requested a full tablet report, sending...
I20260812 00:22:05.683351 30326 ts_manager.cc:194] Registered new tserver with Master: 2655d1a63e33409ab57074f88e7481b6 (127.18.163.193:36507)
W20260812 00:22:06.064162 30546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:22:06.064497 30546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:22:06.064680 30546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:22:06.073338 30546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:22:06.073467 30546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:22:06.073659 30546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:22:06.083667 30546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37533
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:22:06.085198 30546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:22:06.087322 30546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:22:06.102599 30553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:06.102715 30555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:06.102651 30552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:22:06.103785 30546 server_base.cc:1034] running on GCE node
I20260812 00:22:06.104489 30546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:22:06.105701 30546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:22:06.106971 30546 hybrid_clock.cc:648] HybridClock initialized: now 1786494126106917 us; error 53 us; skew 500 ppm
I20260812 00:22:06.107374 30546 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:22:06.110061 30546 webserver.cc:460] Webserver started at http://127.18.163.194:33489/ using document root <none> and password file <none>
I20260812 00:22:06.110874 30546 fs_manager.cc:359] Metadata directory not provided
I20260812 00:22:06.111025 30546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:22:06.111389 30546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:22:06.114712 30546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "e3554cfe392f47499862d54f81324e5d"
format_stamp: "Formatted at 2026-08-12 00:22:06 on dist-test-slave-njxd"
server_key: "0bed296526b297dc62758bfae8546e11"
server_key_iv: "87b503b2c80734f3f7f5c06e2eae0cba"
server_key_version: "encryptionkey@0"
I20260812 00:22:06.115701 30546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "e3554cfe392f47499862d54f81324e5d"
format_stamp: "Formatted at 2026-08-12 00:22:06 on dist-test-slave-njxd"
server_key: "0bed296526b297dc62758bfae8546e11"
server_key_iv: "87b503b2c80734f3f7f5c06e2eae0cba"
server_key_version: "encryptionkey@0"
I20260812 00:22:06.123132 30546 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260812 00:22:06.127807 30561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:06.129683 30546 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260812 00:22:06.129923 30546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "e3554cfe392f47499862d54f81324e5d"
format_stamp: "Formatted at 2026-08-12 00:22:06 on dist-test-slave-njxd"
server_key: "0bed296526b297dc62758bfae8546e11"
server_key_iv: "87b503b2c80734f3f7f5c06e2eae0cba"
server_key_version: "encryptionkey@0"
I20260812 00:22:06.130213 30546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:22:06.136907 30546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:22:06.137948 30546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:22:06.138267 30546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:22:06.139356 30546 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:22:06.141146 30546 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:22:06.141291 30546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:06.141431 30546 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:22:06.141533 30546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:06.178128 30546 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:36065
I20260812 00:22:06.178129 30702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:36065 every 8 connection(s)
I20260812 00:22:06.179744 30546 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:22:06.188637 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 30546
I20260812 00:22:06.188876 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:22:06.189550 19087 external_mini_cluster.cc:1428] Setting key 21c7034f0c98bdf6485fa1d0c27e443b
I20260812 00:22:06.189925 30705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:06.182957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:41293 (local address 127.18.163.254:37533)
0812 00:22:06.183424 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:06.183429 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:06.185128 (+ 1699us) server_negotiation.cc:407] Connection header received
0812 00:22:06.187112 (+ 1984us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:06.187117 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:06.187191 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:06.187304 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:06.188953 (+ 1649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:06.188962 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:06.188967 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:22:06.188996 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:06.189064 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:22:06.189083 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:06.189241 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:06.189450 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 00:22:06.189533 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":234,"threads_started":1}
I20260812 00:22:06.191085 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:06.183748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:37533 (local address 127.18.163.194:41293)
0812 00:22:06.184921 (+ 1173us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:06.184964 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:06.186772 (+ 1808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:06.187550 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:06.187560 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:06.187696 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:22:06.188531 (+ 835us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:22:06.188534 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:22:06.188585 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:22:06.188706 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:22:06.189216 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:22:06.189227 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:22:06.189233 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:22:06.189485 (+ 252us) client_negotiation.cc:240] Negotiation successful
0812 00:22:06.189858 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":338,"threads_started":1}
I20260812 00:22:06.192713 30703 heartbeater.cc:347] Connected to a master server at 127.18.163.254:37533
I20260812 00:22:06.193048 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37533
--builtin_ntp_servers=127.18.163.212:36659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 00:22:06.193085 30703 heartbeater.cc:464] Registering TS with master...
I20260812 00:22:06.193871 30703 heartbeater.cc:511] Master 127.18.163.254:37533 requested a full tablet report, sending...
I20260812 00:22:06.195596 30326 ts_manager.cc:194] Registered new tserver with Master: e3554cfe392f47499862d54f81324e5d (127.18.163.194:36065)
W20260812 00:22:06.581602 30709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:22:06.582031 30709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:22:06.582206 30709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:22:06.590314 30709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:22:06.590444 30709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:22:06.590654 30709 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:22:06.600848 30709 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:37533
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:22:06.602391 30709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:22:06.604485 30709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:22:06.619752 30718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:06.619717 30716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:06.619912 30715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:22:06.621043 30709 server_base.cc:1034] running on GCE node
I20260812 00:22:06.621871 30709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:22:06.623004 30709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:22:06.624258 30709 hybrid_clock.cc:648] HybridClock initialized: now 1786494126624209 us; error 35 us; skew 500 ppm
I20260812 00:22:06.624656 30709 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:22:06.627374 30709 webserver.cc:460] Webserver started at http://127.18.163.195:39793/ using document root <none> and password file <none>
I20260812 00:22:06.628197 30709 fs_manager.cc:359] Metadata directory not provided
I20260812 00:22:06.628341 30709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:22:06.628724 30709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:22:06.632125 30709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "a006cb1b84f84ce4ba89a51e61f83757"
format_stamp: "Formatted at 2026-08-12 00:22:06 on dist-test-slave-njxd"
server_key: "318e2caf12548710a534afaf32fa91c0"
server_key_iv: "147e5bd6c245f934b42f82eb0f8c602f"
server_key_version: "encryptionkey@0"
I20260812 00:22:06.633152 30709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "a006cb1b84f84ce4ba89a51e61f83757"
format_stamp: "Formatted at 2026-08-12 00:22:06 on dist-test-slave-njxd"
server_key: "318e2caf12548710a534afaf32fa91c0"
server_key_iv: "147e5bd6c245f934b42f82eb0f8c602f"
server_key_version: "encryptionkey@0"
I20260812 00:22:06.639967 30709 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:22:06.644151 30725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:06.645936 30709 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:22:06.646153 30709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "a006cb1b84f84ce4ba89a51e61f83757"
format_stamp: "Formatted at 2026-08-12 00:22:06 on dist-test-slave-njxd"
server_key: "318e2caf12548710a534afaf32fa91c0"
server_key_iv: "147e5bd6c245f934b42f82eb0f8c602f"
server_key_version: "encryptionkey@0"
I20260812 00:22:06.646430 30709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:22:06.652915 30709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:22:06.654042 30709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:22:06.654385 30709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:22:06.655516 30709 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:22:06.657222 30709 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:22:06.657347 30709 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:06.657511 30709 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:22:06.657709 30709 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:06.686941 30542 heartbeater.cc:503] Master 127.18.163.254:37533 was elected leader, sending a full tablet report...
I20260812 00:22:06.695629 30709 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:39675
I20260812 00:22:06.695683 30854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:39675 every 8 connection(s)
I20260812 00:22:06.697183 30709 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:22:06.699874 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 30709
I20260812 00:22:06.700075 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:22:06.700726 19087 external_mini_cluster.cc:1428] Setting key 1ba40685387ead3a8f1e858518d0bbea
I20260812 00:22:06.706857 30858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:06.700360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:40779 (local address 127.18.163.254:37533)
0812 00:22:06.700904 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:06.700913 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:06.702653 (+ 1740us) server_negotiation.cc:407] Connection header received
0812 00:22:06.704454 (+ 1801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:06.704458 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:06.704515 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:06.704620 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:06.706056 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:06.706060 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:06.706063 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:22:06.706089 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:06.706138 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:22:06.706151 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:06.706256 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:06.706532 (+ 276us) server_negotiation.cc:299] Negotiation successful
0812 00:22:06.706592 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":296,"threads_started":1}
I20260812 00:22:06.707958 30859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:06.701201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:37533 (local address 127.18.163.195:40779)
0812 00:22:06.702456 (+ 1255us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:06.702517 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:06.704168 (+ 1651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:06.704851 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:06.704860 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:06.704961 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:22:06.705733 (+ 772us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:22:06.705735 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:22:06.705779 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:22:06.705878 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:22:06.706311 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:22:06.706322 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:22:06.706329 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 00:22:06.706608 (+ 279us) client_negotiation.cc:240] Negotiation successful
0812 00:22:06.706837 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":410,"threads_started":1}
I20260812 00:22:06.709618 30856 heartbeater.cc:347] Connected to a master server at 127.18.163.254:37533
I20260812 00:22:06.710001 30856 heartbeater.cc:464] Registering TS with master...
I20260812 00:22:06.710681 30856 heartbeater.cc:511] Master 127.18.163.254:37533 requested a full tablet report, sending...
I20260812 00:22:06.712399 30326 ts_manager.cc:194] Registered new tserver with Master: a006cb1b84f84ce4ba89a51e61f83757 (127.18.163.195:39675)
I20260812 00:22:06.716758 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 00:22:06.723518 30858 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:22:06.721932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59422 (local address 127.18.163.254:37533)
0812 00:22:06.722109 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:06.722114 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:06.722666 (+ 552us) server_negotiation.cc:407] Connection header received
0812 00:22:06.722819 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:06.722823 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:06.722877 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:06.722969 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:06.723304 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59422: BlockingRecv error: recv got EOF from 127.0.0.1:59422 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 00:22:06.724215 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 30395
I20260812 00:22:06.728235 30868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:06.725391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33194 (local address 127.18.163.193:36507)
0812 00:22:06.726024 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:06.726031 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:06.726061 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:22:06.726133 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:06.726140 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:06.726358 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:06.726501 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:06.727551 (+ 1050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:06.727557 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:06.727570 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:22:06.727583 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:06.727628 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:22:06.727643 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:06.727790 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:06.727848 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 00:22:06.727934 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":315,"threads_started":1}
I20260812 00:22:06.729548 30535 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:22:06.819521 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 30395
I20260812 00:22:06.842602 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 30546
I20260812 00:22:06.846570 30870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:06.843593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60346 (local address 127.18.163.194:36065)
0812 00:22:06.844144 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:06.844152 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:06.844180 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:22:06.844253 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:06.844260 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:06.844508 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:06.844643 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:06.845766 (+ 1123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:06.845774 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:06.845787 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:22:06.845812 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:06.845861 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:22:06.845876 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:06.845993 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:06.846097 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 00:22:06.846217 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":251,"threads_started":1}
I20260812 00:22:06.848019 30697 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:22:06.934777 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 30546
I20260812 00:22:06.958297 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 30709
I20260812 00:22:06.963038 30872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:06.959586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45524 (local address 127.18.163.195:39675)
0812 00:22:06.960350 (+ 764us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:06.960357 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:06.960392 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:22:06.960458 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:06.960464 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:06.960711 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:06.960851 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:06.962045 (+ 1194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:06.962051 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:06.962063 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:22:06.962081 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:06.962135 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:22:06.962149 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:06.962295 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:06.962559 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 00:22:06.962733 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":382,"threads_started":1}
I20260812 00:22:06.964468 30849 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:22:07.051407 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 30709
I20260812 00:22:07.077150 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 30288
I20260812 00:22:07.081881 30358 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:22:07.202553 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 30288
2026-08-12T00:22:07Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2749 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:22:07 dist-test-slave-njxd krb5kdc[30877](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:22:07 dist-test-slave-njxd krb5kdc[30877](info): set up 2 sockets
Aug 12 00:22:07 dist-test-slave-njxd krb5kdc[30877](info): commencing operation
krb5kdc: starting...
W20260812 00:22:08.427541 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.000s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:22:08 dist-test-slave-njxd krb5kdc[30877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:22:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:22:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:22:08.773247 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:38365
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:35185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:38365
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:22:09.142264 30892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:22:09.142680 30892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:22:09.142855 30892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:22:09.150552 30892 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:22:09.150734 30892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:22:09.150859 30892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:22:09.150961 30892 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:22:09.151048 30892 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:22:09.161665 30892 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:35185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:38365
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:38365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:22:09.163166 30892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:22:09.164582 30892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:22:09.177278 30899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:09.177349 30901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:09.177349 30898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:22:09.178548 30892 server_base.cc:1034] running on GCE node
I20260812 00:22:09.179476 30892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:22:09.181067 30892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:22:09.182335 30892 hybrid_clock.cc:648] HybridClock initialized: now 1786494129182282 us; error 57 us; skew 500 ppm
I20260812 00:22:09.182739 30892 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:22:09 dist-test-slave-njxd krb5kdc[30877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494129, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:22:09.186151 30892 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:22:09.187845 30892 webserver.cc:460] Webserver started at http://127.18.163.254:37015/ using document root <none> and password file <none>
I20260812 00:22:09.188627 30892 fs_manager.cc:359] Metadata directory not provided
I20260812 00:22:09.188799 30892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:22:09.189155 30892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:22:09.192764 30892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "58e7ea4ebf1d4f2ea0b71fc4ab27c34f"
format_stamp: "Formatted at 2026-08-12 00:22:09 on dist-test-slave-njxd"
server_key: "f0aa4dd77a34186d6c2fb41cdd988973"
server_key_iv: "85880aa9a8b176e66eefd4a04a32b779"
server_key_version: "encryptionkey@0"
I20260812 00:22:09.193710 30892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "58e7ea4ebf1d4f2ea0b71fc4ab27c34f"
format_stamp: "Formatted at 2026-08-12 00:22:09 on dist-test-slave-njxd"
server_key: "f0aa4dd77a34186d6c2fb41cdd988973"
server_key_iv: "85880aa9a8b176e66eefd4a04a32b779"
server_key_version: "encryptionkey@0"
I20260812 00:22:09.199760 30892 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:22:09.203611 30909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:09.205133 30892 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260812 00:22:09.205370 30892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "58e7ea4ebf1d4f2ea0b71fc4ab27c34f"
format_stamp: "Formatted at 2026-08-12 00:22:09 on dist-test-slave-njxd"
server_key: "f0aa4dd77a34186d6c2fb41cdd988973"
server_key_iv: "85880aa9a8b176e66eefd4a04a32b779"
server_key_version: "encryptionkey@0"
I20260812 00:22:09.205662 30892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:22:09.223814 30892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:22:09.228379 30892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:22:09.228721 30892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:22:09.248957 30892 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:38365
I20260812 00:22:09.248984 30967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:38365 every 8 connection(s)
I20260812 00:22:09.250685 30892 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:22:09.254796 30968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:22:09.258369 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 30892
I20260812 00:22:09.258594 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:22:09.259320 19087 external_mini_cluster.cc:1428] Setting key da8067fd501e324746059e36f7b2a359
I20260812 00:22:09.269270 30968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f: Bootstrap starting.
I20260812 00:22:09.273381 30968 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f: Neither blocks nor log segments found. Creating new log.
I20260812 00:22:09.274515 30968 log.cc:824] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f: Log is configured to *not* fsync() on all Append() calls
Aug 12 00:22:09 dist-test-slave-njxd krb5kdc[30877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:22:09.278048 30968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f: No bootstrap required, opened a new log
I20260812 00:22:09.285305 30973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:09.261697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53392 (local address 127.18.163.254:38365)
0812 00:22:09.262610 (+ 913us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:09.262629 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:09.262685 (+ 56us) server_negotiation.cc:407] Connection header received
0812 00:22:09.264653 (+ 1968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:09.264690 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:09.265329 (+ 639us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:09.265881 (+ 552us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:09.267674 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:09.269830 (+ 2156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:09.271276 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:09.272385 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:09.272592 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:09.277130 (+ 4538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:09.277138 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:09.277154 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:22:09.277194 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:09.280557 (+ 3363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:22:09.281374 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:22:09.281381 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:22:09.281389 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:22:09.281662 (+ 273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:22:09.282094 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:22:09.282099 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:22:09.282103 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:22:09.282770 (+ 667us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:09.283155 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:09.283638 (+ 483us) server_negotiation.cc:299] Negotiation successful
0812 00:22:09.284130 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":645,"thread_start_us":382,"threads_started":1}
I20260812 00:22:09.286952 30968 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e7ea4ebf1d4f2ea0b71fc4ab27c34f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38365 } }
I20260812 00:22:09.287501 30968 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:22:09.287621 30968 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58e7ea4ebf1d4f2ea0b71fc4ab27c34f, State: Initialized, Role: FOLLOWER
I20260812 00:22:09.288335 30968 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e7ea4ebf1d4f2ea0b71fc4ab27c34f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38365 } }
I20260812 00:22:09.288672 30968 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:22:09.288834 30968 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:22:09.289018 30968 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:22:09.292245 30968 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e7ea4ebf1d4f2ea0b71fc4ab27c34f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38365 } }
I20260812 00:22:09.292833 30968 leader_election.cc:302] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58e7ea4ebf1d4f2ea0b71fc4ab27c34f; no voters:
I20260812 00:22:09.293476 30968 leader_election.cc:288] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:22:09.293668 30975 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:22:09.295116 30975 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [term 1 LEADER]: Becoming Leader. State: Replica: 58e7ea4ebf1d4f2ea0b71fc4ab27c34f, State: Running, Role: LEADER
I20260812 00:22:09.295652 30975 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e7ea4ebf1d4f2ea0b71fc4ab27c34f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38365 } }
I20260812 00:22:09.296036 30968 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:22:09.298784 30977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58e7ea4ebf1d4f2ea0b71fc4ab27c34f. Latest consensus state: current_term: 1 leader_uuid: "58e7ea4ebf1d4f2ea0b71fc4ab27c34f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e7ea4ebf1d4f2ea0b71fc4ab27c34f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38365 } } }
I20260812 00:22:09.299283 30977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [sys.catalog]: This master's current role is: LEADER
I20260812 00:22:09.298761 30976 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58e7ea4ebf1d4f2ea0b71fc4ab27c34f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e7ea4ebf1d4f2ea0b71fc4ab27c34f" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38365 } } }
I20260812 00:22:09.299682 30976 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f [sys.catalog]: This master's current role is: LEADER
I20260812 00:22:09.302378 30980 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:22:09.307646 30980 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:22:09.316932 30980 catalog_manager.cc:1347] Generated new cluster ID: 4c75b3906aca4bd5b989d52516a5c099
I20260812 00:22:09.317070 30980 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:22:09.342015 30980 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:22:09.344173 30980 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:22:09.366943 30980 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f: Generated new TSK 0
I20260812 00:22:09.368216 30980 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:22:09.462321 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:38365
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:35185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:22:09.867075 31000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:22:09.867484 31000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:22:09.867655 31000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:22:09.875571 31000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:22:09.875725 31000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:22:09.875955 31000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:22:09.887043 31000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:35185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:38365
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:22:09.888578 31000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:22:09.890146 31000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:22:09.905009 31005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:09.904963 31009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:09.905015 31007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:22:09.906154 31000 server_base.cc:1034] running on GCE node
I20260812 00:22:09.906857 31000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:22:09.907917 31000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:22:09.909139 31000 hybrid_clock.cc:648] HybridClock initialized: now 1786494129909090 us; error 37 us; skew 500 ppm
I20260812 00:22:09.909525 31000 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:22:09 dist-test-slave-njxd krb5kdc[30877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494129, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:22:09.913246 31000 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:22:09.915081 31000 webserver.cc:460] Webserver started at http://127.18.163.193:38719/ using document root <none> and password file <none>
I20260812 00:22:09.915899 31000 fs_manager.cc:359] Metadata directory not provided
I20260812 00:22:09.916059 31000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:22:09.916435 31000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:22:09.919836 31000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "4212bdf9f22044e5a3d7f1861c4f4488"
format_stamp: "Formatted at 2026-08-12 00:22:09 on dist-test-slave-njxd"
server_key: "97025971b030d6ba80291a2dd7ec8447"
server_key_iv: "84ccd1ce2ee76469488da26911293594"
server_key_version: "encryptionkey@0"
I20260812 00:22:09.920753 31000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "4212bdf9f22044e5a3d7f1861c4f4488"
format_stamp: "Formatted at 2026-08-12 00:22:09 on dist-test-slave-njxd"
server_key: "97025971b030d6ba80291a2dd7ec8447"
server_key_iv: "84ccd1ce2ee76469488da26911293594"
server_key_version: "encryptionkey@0"
I20260812 00:22:09.926753 31000 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:22:09.930660 31016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:09.932255 31000 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260812 00:22:09.932472 31000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "4212bdf9f22044e5a3d7f1861c4f4488"
format_stamp: "Formatted at 2026-08-12 00:22:09 on dist-test-slave-njxd"
server_key: "97025971b030d6ba80291a2dd7ec8447"
server_key_iv: "84ccd1ce2ee76469488da26911293594"
server_key_version: "encryptionkey@0"
I20260812 00:22:09.932708 31000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:22:09.946724 31000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:22:09.951356 31000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:22:09.951699 31000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:22:09.952764 31000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:22:09.954314 31000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:22:09.954427 31000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:09.954604 31000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:22:09.954689 31000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:09.990363 31000 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:46257
I20260812 00:22:09.990458 31147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:46257 every 8 connection(s)
I20260812 00:22:09.991852 31000 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:22:09.999715 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 31000
I20260812 00:22:09.999939 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:22:10.000850 19087 external_mini_cluster.cc:1428] Setting key bd28735b9a1afc90aa033007fdc6ae6d
Aug 12 00:22:10 dist-test-slave-njxd krb5kdc[30877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494129, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:22:10.015076 31150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:09.994808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:57865 (local address 127.18.163.254:38365)
0812 00:22:09.995341 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:09.995348 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:09.996499 (+ 1151us) server_negotiation.cc:407] Connection header received
0812 00:22:09.998587 (+ 2088us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:09.998592 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:09.998673 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:09.998790 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:10.001147 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:10.002045 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:10.003971 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:10.004391 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:10.004545 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:10.008648 (+ 4103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:10.008654 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:10.008657 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:22:10.008695 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:10.011549 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:22:10.012409 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:22:10.012416 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:22:10.012420 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:22:10.012564 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:22:10.013038 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:22:10.013043 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:22:10.013046 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:22:10.013344 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:10.013516 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:10.014367 (+ 851us) server_negotiation.cc:299] Negotiation successful
0812 00:22:10.014653 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":239,"threads_started":1}
I20260812 00:22:10.016149 31151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:09.995495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:38365 (local address 127.18.163.193:57865)
0812 00:22:09.996298 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:09.996341 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:09.998272 (+ 1931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:09.999027 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:09.999036 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:09.999955 (+ 919us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:22:10.000909 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:10.000942 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:10.002246 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:10.002250 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:10.003798 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:10.003813 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:10.004667 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:10.004674 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:10.004942 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:10.005761 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:22:10.005788 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:22:10.008378 (+ 2590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:22:10.011735 (+ 3357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:22:10.011745 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:22:10.011765 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:22:10.012264 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:22:10.012689 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:22:10.012695 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:22:10.012698 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:22:10.012915 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:22:10.013486 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:22:10.013495 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:22:10.013956 (+ 461us) client_negotiation.cc:769] Sending connection context
0812 00:22:10.014269 (+ 313us) client_negotiation.cc:240] Negotiation successful
0812 00:22:10.014916 (+ 647us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":375,"threads_started":1}
I20260812 00:22:10.018180 31148 heartbeater.cc:347] Connected to a master server at 127.18.163.254:38365
I20260812 00:22:10.018570 31148 heartbeater.cc:464] Registering TS with master...
I20260812 00:22:10.019399 31148 heartbeater.cc:511] Master 127.18.163.254:38365 requested a full tablet report, sending...
I20260812 00:22:10.022061 30929 ts_manager.cc:194] Registered new tserver with Master: 4212bdf9f22044e5a3d7f1861c4f4488 (127.18.163.193:46257)
I20260812 00:22:10.023623 30929 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:57865
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:22:10.077144 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:38365
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:35185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:22:10.457481 31155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:22:10.457911 31155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:22:10.458020 31155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:22:10.465752 31155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:22:10.465890 31155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:22:10.466018 31155 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:22:10.476459 31155 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:35185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:38365
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:22:10.478013 31155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:22:10.479446 31155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:22:10.493940 31160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:10.494125 31161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:10.494295 31163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:22:10.495065 31155 server_base.cc:1034] running on GCE node
I20260812 00:22:10.495847 31155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:22:10.497045 31155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:22:10.498339 31155 hybrid_clock.cc:648] HybridClock initialized: now 1786494130498274 us; error 69 us; skew 500 ppm
I20260812 00:22:10.498682 31155 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:22:10 dist-test-slave-njxd krb5kdc[30877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494130, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:22:10.508164 31155 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:22:10.510213 31155 webserver.cc:460] Webserver started at http://127.18.163.194:45265/ using document root <none> and password file <none>
I20260812 00:22:10.511070 31155 fs_manager.cc:359] Metadata directory not provided
I20260812 00:22:10.511271 31155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:22:10.511651 31155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:22:10.515021 31155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "3bb030e4d75948799103fef6e524c40e"
format_stamp: "Formatted at 2026-08-12 00:22:10 on dist-test-slave-njxd"
server_key: "033013e57f2a127993e7f0dc5be4f7da"
server_key_iv: "ab3822f1dbde33777534fb2aa2656f47"
server_key_version: "encryptionkey@0"
I20260812 00:22:10.515934 31155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "3bb030e4d75948799103fef6e524c40e"
format_stamp: "Formatted at 2026-08-12 00:22:10 on dist-test-slave-njxd"
server_key: "033013e57f2a127993e7f0dc5be4f7da"
server_key_iv: "ab3822f1dbde33777534fb2aa2656f47"
server_key_version: "encryptionkey@0"
I20260812 00:22:10.522564 31155 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 00:22:10.526777 31171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:10.528434 31155 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:22:10.528685 31155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "3bb030e4d75948799103fef6e524c40e"
format_stamp: "Formatted at 2026-08-12 00:22:10 on dist-test-slave-njxd"
server_key: "033013e57f2a127993e7f0dc5be4f7da"
server_key_iv: "ab3822f1dbde33777534fb2aa2656f47"
server_key_version: "encryptionkey@0"
I20260812 00:22:10.528947 31155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:22:10.547533 31155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:22:10.552171 31155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:22:10.552549 31155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:22:10.553714 31155 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:22:10.555400 31155 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:22:10.555518 31155 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:10.555691 31155 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:22:10.555768 31155 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:10.594988 31155 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:43817
I20260812 00:22:10.595041 31298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:43817 every 8 connection(s)
I20260812 00:22:10.596508 31155 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:22:10.603847 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 31155
I20260812 00:22:10.604064 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:22:10.604554 19087 external_mini_cluster.cc:1428] Setting key 291a39cf55003853b9cddaf671ceddf0
Aug 12 00:22:10 dist-test-slave-njxd krb5kdc[30877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494130, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:22:10.621158 31302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:10.599445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:37229 (local address 127.18.163.254:38365)
0812 00:22:10.599953 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:10.599958 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:10.600884 (+ 926us) server_negotiation.cc:407] Connection header received
0812 00:22:10.603008 (+ 2124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:10.603014 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:10.603176 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:10.603299 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:10.605300 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:10.606304 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:10.608214 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:10.609010 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:10.609188 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:10.613404 (+ 4216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:10.613413 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:10.613421 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:22:10.613474 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:10.617326 (+ 3852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:22:10.618314 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:22:10.618323 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:22:10.618329 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:22:10.618504 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:22:10.618978 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:22:10.618986 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:22:10.618991 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:22:10.619435 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:10.619603 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:10.620379 (+ 776us) server_negotiation.cc:299] Negotiation successful
0812 00:22:10.620671 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":267,"threads_started":1}
I20260812 00:22:10.622005 31303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:10.599909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:38365 (local address 127.18.163.194:37229)
0812 00:22:10.600691 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:10.600742 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:10.602672 (+ 1930us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:10.603603 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:10.603612 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:10.604333 (+ 721us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:22:10.605049 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:10.605070 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:10.606506 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:10.606510 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:10.608018 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:10.608033 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:10.609334 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:10.609340 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:10.609824 (+ 484us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:10.610695 (+ 871us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:22:10.610727 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:22:10.613102 (+ 2375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:22:10.617549 (+ 4447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:22:10.617558 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:22:10.617619 (+ 61us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:22:10.618165 (+ 546us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:22:10.618630 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:22:10.618634 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:22:10.618636 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:22:10.618850 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:22:10.619567 (+ 717us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:22:10.619574 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:22:10.619951 (+ 377us) client_negotiation.cc:769] Sending connection context
0812 00:22:10.620198 (+ 247us) client_negotiation.cc:240] Negotiation successful
0812 00:22:10.620661 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":318,"threads_started":1}
I20260812 00:22:10.623741 31299 heartbeater.cc:347] Connected to a master server at 127.18.163.254:38365
I20260812 00:22:10.624076 31299 heartbeater.cc:464] Registering TS with master...
I20260812 00:22:10.624891 31299 heartbeater.cc:511] Master 127.18.163.254:38365 requested a full tablet report, sending...
I20260812 00:22:10.626701 30929 ts_manager.cc:194] Registered new tserver with Master: 3bb030e4d75948799103fef6e524c40e (127.18.163.194:43817)
I20260812 00:22:10.628139 30929 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:37229
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
I20260812 00:22:10.681656 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:38365
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:35185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:22:11.027868 31148 heartbeater.cc:503] Master 127.18.163.254:38365 was elected leader, sending a full tablet report...
W20260812 00:22:11.068924 31308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:22:11.069344 31308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:22:11.069533 31308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:22:11.081108 31308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:22:11.081248 31308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:22:11.081372 31308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:22:11.092123 31308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:35185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:38365
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:22:11.093537 31308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:22:11.094986 31308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:22:11.109659 31314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:11.109675 31313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:22:11.109980 31316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:22:11.110853 31308 server_base.cc:1034] running on GCE node
I20260812 00:22:11.111644 31308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:22:11.112677 31308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:22:11.113891 31308 hybrid_clock.cc:648] HybridClock initialized: now 1786494131113833 us; error 50 us; skew 500 ppm
I20260812 00:22:11.114265 31308 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:22:11 dist-test-slave-njxd krb5kdc[30877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494131, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:22:11.117888 31308 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:22:11.119529 31308 webserver.cc:460] Webserver started at http://127.18.163.195:42913/ using document root <none> and password file <none>
I20260812 00:22:11.120260 31308 fs_manager.cc:359] Metadata directory not provided
I20260812 00:22:11.120373 31308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:22:11.120641 31308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:22:11.123870 31308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "19a48dfac4894106bf2b372f5d396a86"
format_stamp: "Formatted at 2026-08-12 00:22:11 on dist-test-slave-njxd"
server_key: "5c6a8273bff7d341d3b8a7d4da547bf6"
server_key_iv: "f1c51e109d6d1b8f5400a0df3c7b51dd"
server_key_version: "encryptionkey@0"
I20260812 00:22:11.124697 31308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "19a48dfac4894106bf2b372f5d396a86"
format_stamp: "Formatted at 2026-08-12 00:22:11 on dist-test-slave-njxd"
server_key: "5c6a8273bff7d341d3b8a7d4da547bf6"
server_key_iv: "f1c51e109d6d1b8f5400a0df3c7b51dd"
server_key_version: "encryptionkey@0"
I20260812 00:22:11.130391 31308 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 00:22:11.134487 31328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:11.136126 31308 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:22:11.136349 31308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "19a48dfac4894106bf2b372f5d396a86"
format_stamp: "Formatted at 2026-08-12 00:22:11 on dist-test-slave-njxd"
server_key: "5c6a8273bff7d341d3b8a7d4da547bf6"
server_key_iv: "f1c51e109d6d1b8f5400a0df3c7b51dd"
server_key_version: "encryptionkey@0"
I20260812 00:22:11.136583 31308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:22:11.151445 31308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:22:11.156574 31308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:22:11.156946 31308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:22:11.158131 31308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:22:11.159710 31308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:22:11.159828 31308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:11.159991 31308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:22:11.160073 31308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:22:11.195885 31308 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:40755
I20260812 00:22:11.195921 31457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:40755 every 8 connection(s)
I20260812 00:22:11.197479 31308 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:22:11.201608 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 31308
I20260812 00:22:11.201814 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:22:11.202409 19087 external_mini_cluster.cc:1428] Setting key 7640a85995ddf96bf9928dfef07e51dc
Aug 12 00:22:11 dist-test-slave-njxd krb5kdc[30877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494131, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:22:11.220410 31460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.200399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:45619 (local address 127.18.163.254:38365)
0812 00:22:11.200917 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:11.200922 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:11.202207 (+ 1285us) server_negotiation.cc:407] Connection header received
0812 00:22:11.204684 (+ 2477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:11.204688 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:11.204760 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:11.204855 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:11.206913 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.207699 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.209308 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.209781 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.209962 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.213702 (+ 3740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:11.213708 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:11.213711 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:22:11.213753 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:11.216417 (+ 2664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:22:11.217446 (+ 1029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:22:11.217454 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:22:11.217463 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:22:11.217739 (+ 276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:22:11.218318 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:22:11.218323 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:22:11.218327 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:22:11.218775 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:11.218905 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:11.219889 (+ 984us) server_negotiation.cc:299] Negotiation successful
0812 00:22:11.220103 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":263,"threads_started":1}
I20260812 00:22:11.221475 31461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.201054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:38365 (local address 127.18.163.195:45619)
0812 00:22:11.202028 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:11.202077 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:11.204359 (+ 2282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:11.205086 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:11.205095 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:11.206011 (+ 916us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:22:11.206747 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:11.206767 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.207842 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.207846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:11.209140 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:11.209182 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.210052 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.210057 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:11.210272 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.210956 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:22:11.211008 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:22:11.213382 (+ 2374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:22:11.216657 (+ 3275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:22:11.216668 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:22:11.216690 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:22:11.217294 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:22:11.217910 (+ 616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:22:11.217915 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:22:11.217918 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:22:11.218179 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:22:11.218947 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:22:11.218957 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:22:11.219491 (+ 534us) client_negotiation.cc:769] Sending connection context
0812 00:22:11.219752 (+ 261us) client_negotiation.cc:240] Negotiation successful
0812 00:22:11.220224 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"thread_start_us":381,"threads_started":1}
I20260812 00:22:11.223055 31458 heartbeater.cc:347] Connected to a master server at 127.18.163.254:38365
I20260812 00:22:11.223420 31458 heartbeater.cc:464] Registering TS with master...
I20260812 00:22:11.224253 31458 heartbeater.cc:511] Master 127.18.163.254:38365 requested a full tablet report, sending...
I20260812 00:22:11.225970 30929 ts_manager.cc:194] Registered new tserver with Master: 19a48dfac4894106bf2b372f5d396a86 (127.18.163.195:40755)
I20260812 00:22:11.226861 30929 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:45619
I20260812 00:22:11.231956 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:22:11.251067 31460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.236917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53396 (local address 127.18.163.254:38365)
0812 00:22:11.237124 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:11.237133 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:11.237750 (+ 617us) server_negotiation.cc:407] Connection header received
0812 00:22:11.237981 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:11.237988 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:11.238084 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:11.238196 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:11.239722 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.240505 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.242104 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.242535 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.242652 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.245265 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:11.245270 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:11.245274 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:22:11.245316 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:11.247930 (+ 2614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:22:11.248655 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:22:11.248660 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:22:11.248663 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:22:11.248829 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:22:11.249219 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:22:11.249226 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:22:11.249236 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:22:11.249804 (+ 568us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:11.250066 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:11.250435 (+ 369us) server_negotiation.cc:299] Negotiation successful
0812 00:22:11.250710 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 00:22:11.255985 30929 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53396:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:22:11.263479 30929 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:22:11.298774 31476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.277479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:40755 (local address 127.0.0.1:43056)
0812 00:22:11.286397 (+ 8918us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:11.286480 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:11.286759 (+ 279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:11.289302 (+ 2543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:11.289314 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:11.289355 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:22:11.290892 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:11.290908 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.292679 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.292687 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:11.295312 (+ 2625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:11.295331 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.297508 (+ 2177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.297515 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:11.297775 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.297859 (+ 84us) client_negotiation.cc:769] Sending connection context
0812 00:22:11.298001 (+ 142us) client_negotiation.cc:240] Negotiation successful
0812 00:22:11.298243 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8491,"mutex_wait_us":177,"thread_start_us":11080,"threads_started":1}
I20260812 00:22:11.298977 31475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.278008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41264 (local address 127.18.163.194:43817)
0812 00:22:11.290045 (+ 12037us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:11.290054 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:11.290082 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:22:11.290177 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:11.290183 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:11.290406 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:11.290598 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:22:11.291737 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.293362 (+ 1625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.296311 (+ 2949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.297746 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.297929 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.298132 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:11.298401 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 00:22:11.298592 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11874,"thread_start_us":11697,"threads_started":1}
I20260812 00:22:11.300006 31473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.277615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43056 (local address 127.18.163.195:40755)
0812 00:22:11.288521 (+ 10906us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:11.288533 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:11.288576 (+ 43us) server_negotiation.cc:407] Connection header received
0812 00:22:11.288693 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:11.288703 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:11.289009 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:11.290043 (+ 1034us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:22:11.291305 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.292528 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.295510 (+ 2982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.297278 (+ 1768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.297494 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.297734 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:11.299478 (+ 1744us) server_negotiation.cc:299] Negotiation successful
0812 00:22:11.299694 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10710,"thread_start_us":10544,"threads_started":1}
I20260812 00:22:11.300487 31477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.281863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44860 (local address 127.18.163.193:46257)
0812 00:22:11.289638 (+ 7775us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:11.289652 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:11.289691 (+ 39us) server_negotiation.cc:407] Connection header received
0812 00:22:11.289800 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:11.289806 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:11.290054 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:11.290291 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:22:11.291702 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.293390 (+ 1688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.296458 (+ 3068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.298072 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.298285 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.299964 (+ 1679us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:11.300043 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 00:22:11.300226 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7516,"thread_start_us":7325,"threads_started":1}
I20260812 00:22:11.300761 31472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.280900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:46257 (local address 127.0.0.1:44860)
0812 00:22:11.288884 (+ 7984us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:11.289326 (+ 442us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:11.289444 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:11.290401 (+ 957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:11.290408 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:11.290441 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:22:11.291457 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:11.291475 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.293564 (+ 2089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.293600 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:11.296259 (+ 2659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:11.296277 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.298950 (+ 2673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.298957 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:11.299126 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.299160 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:22:11.299241 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 00:22:11.299370 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7853,"mutex_wait_us":84,"thread_start_us":4804,"threads_started":1}
I20260812 00:22:11.300806 31474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.277671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:43817 (local address 127.0.0.1:41264)
0812 00:22:11.287535 (+ 9864us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:11.287558 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:11.287678 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:11.290616 (+ 2938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:11.290624 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:11.290652 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:22:11.291513 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:11.291524 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.293533 (+ 2009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.293541 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:11.296096 (+ 2555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:11.296120 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.297976 (+ 1856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.297983 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:11.298180 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.298213 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 00:22:11.298318 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 00:22:11.299862 (+ 1544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9717,"mutex_wait_us":104,"thread_start_us":9560,"threads_started":1}
I20260812 00:22:11.304431 31383 tablet_service.cc:1467] Processing CreateTablet for tablet a8c7a0f1469a41c286491f36e5602905 (DEFAULT_TABLE table=test-table [id=6b4c5ca9769d4fa6a86a50beda6164fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:22:11.304649 31222 tablet_service.cc:1467] Processing CreateTablet for tablet a8c7a0f1469a41c286491f36e5602905 (DEFAULT_TABLE table=test-table [id=6b4c5ca9769d4fa6a86a50beda6164fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:22:11.304649 31074 tablet_service.cc:1467] Processing CreateTablet for tablet a8c7a0f1469a41c286491f36e5602905 (DEFAULT_TABLE table=test-table [id=6b4c5ca9769d4fa6a86a50beda6164fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:22:11.306237 31222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8c7a0f1469a41c286491f36e5602905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:22:11.306231 31074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8c7a0f1469a41c286491f36e5602905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:22:11.306447 31383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8c7a0f1469a41c286491f36e5602905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:22:11.319437 31478 tablet_bootstrap.cc:492] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86: Bootstrap starting.
I20260812 00:22:11.322409 31479 tablet_bootstrap.cc:492] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e: Bootstrap starting.
I20260812 00:22:11.325839 31478 tablet_bootstrap.cc:654] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86: Neither blocks nor log segments found. Creating new log.
I20260812 00:22:11.326169 31479 tablet_bootstrap.cc:654] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e: Neither blocks nor log segments found. Creating new log.
I20260812 00:22:11.326426 31480 tablet_bootstrap.cc:492] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488: Bootstrap starting.
I20260812 00:22:11.327598 31479 log.cc:824] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:22:11.327598 31478 log.cc:824] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86: Log is configured to *not* fsync() on all Append() calls
I20260812 00:22:11.330256 31480 tablet_bootstrap.cc:654] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488: Neither blocks nor log segments found. Creating new log.
I20260812 00:22:11.331383 31480 log.cc:824] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488: Log is configured to *not* fsync() on all Append() calls
I20260812 00:22:11.331691 31479 tablet_bootstrap.cc:492] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e: No bootstrap required, opened a new log
I20260812 00:22:11.331983 31479 ts_tablet_manager.cc:1397] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260812 00:22:11.335055 31480 tablet_bootstrap.cc:492] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488: No bootstrap required, opened a new log
I20260812 00:22:11.335420 31480 ts_tablet_manager.cc:1397] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260812 00:22:11.335814 31478 tablet_bootstrap.cc:492] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86: No bootstrap required, opened a new log
I20260812 00:22:11.336110 31478 ts_tablet_manager.cc:1397] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.005s
I20260812 00:22:11.341380 31479 raft_consensus.cc:348] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a48dfac4894106bf2b372f5d396a86" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40755 } } peers { permanent_uuid: "3bb030e4d75948799103fef6e524c40e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43817 } } peers { permanent_uuid: "4212bdf9f22044e5a3d7f1861c4f4488" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46257 } }
I20260812 00:22:11.342010 31479 raft_consensus.cc:374] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:22:11.342120 31479 raft_consensus.cc:729] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb030e4d75948799103fef6e524c40e, State: Initialized, Role: FOLLOWER
I20260812 00:22:11.342875 31479 consensus_queue.cc:260] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a48dfac4894106bf2b372f5d396a86" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40755 } } peers { permanent_uuid: "3bb030e4d75948799103fef6e524c40e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43817 } } peers { permanent_uuid: "4212bdf9f22044e5a3d7f1861c4f4488" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46257 } }
I20260812 00:22:11.344177 31299 heartbeater.cc:503] Master 127.18.163.254:38365 was elected leader, sending a full tablet report...
I20260812 00:22:11.344980 31479 ts_tablet_manager.cc:1428] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260812 00:22:11.347370 31480 raft_consensus.cc:348] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a48dfac4894106bf2b372f5d396a86" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40755 } } peers { permanent_uuid: "3bb030e4d75948799103fef6e524c40e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43817 } } peers { permanent_uuid: "4212bdf9f22044e5a3d7f1861c4f4488" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46257 } }
I20260812 00:22:11.347384 31478 raft_consensus.cc:348] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a48dfac4894106bf2b372f5d396a86" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40755 } } peers { permanent_uuid: "3bb030e4d75948799103fef6e524c40e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43817 } } peers { permanent_uuid: "4212bdf9f22044e5a3d7f1861c4f4488" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46257 } }
I20260812 00:22:11.347890 31480 raft_consensus.cc:374] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:22:11.347890 31478 raft_consensus.cc:374] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:22:11.348001 31480 raft_consensus.cc:729] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4212bdf9f22044e5a3d7f1861c4f4488, State: Initialized, Role: FOLLOWER
I20260812 00:22:11.348009 31478 raft_consensus.cc:729] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a48dfac4894106bf2b372f5d396a86, State: Initialized, Role: FOLLOWER
W20260812 00:22:11.348766 31300 tablet.cc:2369] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:22:11.348766 31478 consensus_queue.cc:260] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a48dfac4894106bf2b372f5d396a86" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40755 } } peers { permanent_uuid: "3bb030e4d75948799103fef6e524c40e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43817 } } peers { permanent_uuid: "4212bdf9f22044e5a3d7f1861c4f4488" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46257 } }
I20260812 00:22:11.349324 31480 consensus_queue.cc:260] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a48dfac4894106bf2b372f5d396a86" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40755 } } peers { permanent_uuid: "3bb030e4d75948799103fef6e524c40e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43817 } } peers { permanent_uuid: "4212bdf9f22044e5a3d7f1861c4f4488" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46257 } }
I20260812 00:22:11.350625 31458 heartbeater.cc:503] Master 127.18.163.254:38365 was elected leader, sending a full tablet report...
I20260812 00:22:11.351444 31478 ts_tablet_manager.cc:1428] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260812 00:22:11.353518 31480 ts_tablet_manager.cc:1428] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488: Time spent starting tablet: real 0.018s user 0.018s sys 0.000s
W20260812 00:22:11.449294 31459 tablet.cc:2369] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:22:11.494850 31149 tablet.cc:2369] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:22:11.555784 31484 raft_consensus.cc:482] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:22:11.556134 31484 raft_consensus.cc:504] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a48dfac4894106bf2b372f5d396a86" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40755 } } peers { permanent_uuid: "3bb030e4d75948799103fef6e524c40e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43817 } } peers { permanent_uuid: "4212bdf9f22044e5a3d7f1861c4f4488" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46257 } }
I20260812 00:22:11.558063 31484 leader_election.cc:288] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a48dfac4894106bf2b372f5d396a86 (127.18.163.195:40755), 4212bdf9f22044e5a3d7f1861c4f4488 (127.18.163.193:46257)
I20260812 00:22:11.567471 31477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.558667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:45155 (local address 127.18.163.193:46257)
0812 00:22:11.558934 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:11.558942 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:11.559535 (+ 593us) server_negotiation.cc:407] Connection header received
0812 00:22:11.559744 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:11.559749 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:11.559830 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:11.559917 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:22:11.560571 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.561737 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.564740 (+ 3003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.566109 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.566311 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.566397 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:11.567022 (+ 625us) server_negotiation.cc:299] Negotiation successful
0812 00:22:11.567179 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 00:22:11.567466 31473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.558682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:53795 (local address 127.18.163.195:40755)
0812 00:22:11.558988 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:11.558996 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:11.559588 (+ 592us) server_negotiation.cc:407] Connection header received
0812 00:22:11.560092 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:11.560096 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:11.560158 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:11.560230 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:22:11.560857 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.561952 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.564725 (+ 2773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.566109 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.566311 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.566397 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:11.567022 (+ 625us) server_negotiation.cc:299] Negotiation successful
0812 00:22:11.567179 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260812 00:22:11.567770 31488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.558501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:46257 (local address 127.18.163.194:45155)
0812 00:22:11.559417 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:11.559435 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:11.559596 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:11.559956 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:11.559959 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:11.559982 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:22:11.560364 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:11.560383 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.561897 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.561901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:11.564518 (+ 2617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:11.564537 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.566449 (+ 1912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.566456 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:11.566724 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.566840 (+ 116us) client_negotiation.cc:769] Sending connection context
0812 00:22:11.566960 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 00:22:11.567179 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":815,"mutex_wait_us":140,"thread_start_us":518,"threads_started":1}
I20260812 00:22:11.567791 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.558455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:40755 (local address 127.18.163.194:53795)
0812 00:22:11.559377 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:11.559405 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:11.559599 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:11.560286 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:11.560296 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:11.560325 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:22:11.560700 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:11.560710 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.562076 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.562084 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:11.564515 (+ 2431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:11.564537 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.566461 (+ 1924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.566466 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:11.566726 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.566841 (+ 115us) client_negotiation.cc:769] Sending connection context
0812 00:22:11.566960 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 00:22:11.567179 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":736,"mutex_wait_us":212,"spinlock_wait_cycles":51584,"thread_start_us":685,"threads_started":1}
I20260812 00:22:11.568766 31487 raft_consensus.cc:482] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:22:11.569265 31099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8c7a0f1469a41c286491f36e5602905" candidate_uuid: "3bb030e4d75948799103fef6e524c40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4212bdf9f22044e5a3d7f1861c4f4488" is_pre_election: true
I20260812 00:22:11.569275 31407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8c7a0f1469a41c286491f36e5602905" candidate_uuid: "3bb030e4d75948799103fef6e524c40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a48dfac4894106bf2b372f5d396a86" is_pre_election: true
I20260812 00:22:11.569159 31487 raft_consensus.cc:504] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a48dfac4894106bf2b372f5d396a86" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40755 } } peers { permanent_uuid: "3bb030e4d75948799103fef6e524c40e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43817 } } peers { permanent_uuid: "4212bdf9f22044e5a3d7f1861c4f4488" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46257 } }
I20260812 00:22:11.569950 31407 raft_consensus.cc:2454] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bb030e4d75948799103fef6e524c40e in term 0.
I20260812 00:22:11.570240 31099 raft_consensus.cc:2454] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bb030e4d75948799103fef6e524c40e in term 0.
I20260812 00:22:11.570899 31175 leader_election.cc:302] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a48dfac4894106bf2b372f5d396a86, 3bb030e4d75948799103fef6e524c40e; no voters:
I20260812 00:22:11.571431 31484 raft_consensus.cc:2781] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:22:11.571602 31484 raft_consensus.cc:482] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:22:11.571753 31484 raft_consensus.cc:3037] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:22:11.573220 31487 leader_election.cc:288] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a48dfac4894106bf2b372f5d396a86 (127.18.163.195:40755), 3bb030e4d75948799103fef6e524c40e (127.18.163.194:43817)
I20260812 00:22:11.575616 31484 raft_consensus.cc:504] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a48dfac4894106bf2b372f5d396a86" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40755 } } peers { permanent_uuid: "3bb030e4d75948799103fef6e524c40e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43817 } } peers { permanent_uuid: "4212bdf9f22044e5a3d7f1861c4f4488" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46257 } }
I20260812 00:22:11.576802 31484 leader_election.cc:288] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [CANDIDATE]: Term 1 election: Requested vote from peers 19a48dfac4894106bf2b372f5d396a86 (127.18.163.195:40755), 4212bdf9f22044e5a3d7f1861c4f4488 (127.18.163.193:46257)
I20260812 00:22:11.577080 31407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8c7a0f1469a41c286491f36e5602905" candidate_uuid: "3bb030e4d75948799103fef6e524c40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a48dfac4894106bf2b372f5d396a86"
I20260812 00:22:11.577361 31407 raft_consensus.cc:3037] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:22:11.577471 31099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8c7a0f1469a41c286491f36e5602905" candidate_uuid: "3bb030e4d75948799103fef6e524c40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4212bdf9f22044e5a3d7f1861c4f4488"
I20260812 00:22:11.577761 31099 raft_consensus.cc:3037] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:22:11.580771 31473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.572319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:37273 (local address 127.18.163.195:40755)
0812 00:22:11.572557 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:11.572567 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:11.573164 (+ 597us) server_negotiation.cc:407] Connection header received
0812 00:22:11.573496 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:11.573502 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:11.573615 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:11.573685 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:22:11.574636 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.575791 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.578770 (+ 2979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.579672 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.579907 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.579992 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:11.580302 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 00:22:11.580446 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 00:22:11.580890 31492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.571853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:40755 (local address 127.18.163.193:37273)
0812 00:22:11.573038 (+ 1185us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:11.573061 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:11.573304 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:11.573921 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:11.573926 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:11.573961 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:22:11.574432 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:11.574447 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.575993 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.575998 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:11.578560 (+ 2562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:11.578576 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.579934 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.579941 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:11.580127 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.580154 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 00:22:11.580274 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 00:22:11.580430 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1027,"mutex_wait_us":105,"thread_start_us":1772,"threads_started":1}
I20260812 00:22:11.581291 31099 raft_consensus.cc:2454] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb030e4d75948799103fef6e524c40e in term 1.
I20260812 00:22:11.581315 31407 raft_consensus.cc:2454] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb030e4d75948799103fef6e524c40e in term 1.
I20260812 00:22:11.581761 31406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8c7a0f1469a41c286491f36e5602905" candidate_uuid: "4212bdf9f22044e5a3d7f1861c4f4488" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a48dfac4894106bf2b372f5d396a86" is_pre_election: true
I20260812 00:22:11.581827 31172 leader_election.cc:302] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 19a48dfac4894106bf2b372f5d396a86, 3bb030e4d75948799103fef6e524c40e, 4212bdf9f22044e5a3d7f1861c4f4488; no voters:
I20260812 00:22:11.582252 31406 raft_consensus.cc:2379] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4212bdf9f22044e5a3d7f1861c4f4488 in current term 1: Already voted for candidate 3bb030e4d75948799103fef6e524c40e in this term.
I20260812 00:22:11.582280 31484 raft_consensus.cc:2781] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:22:11.582913 31484 raft_consensus.cc:686] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [term 1 LEADER]: Becoming Leader. State: Replica: 3bb030e4d75948799103fef6e524c40e, State: Running, Role: LEADER
I20260812 00:22:11.583630 31484 consensus_queue.cc:237] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a48dfac4894106bf2b372f5d396a86" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40755 } } peers { permanent_uuid: "3bb030e4d75948799103fef6e524c40e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43817 } } peers { permanent_uuid: "4212bdf9f22044e5a3d7f1861c4f4488" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46257 } }
I20260812 00:22:11.585564 31475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.572547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:52861 (local address 127.18.163.194:43817)
0812 00:22:11.572807 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:11.572816 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:11.574083 (+ 1267us) server_negotiation.cc:407] Connection header received
0812 00:22:11.574315 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:11.574325 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:11.574388 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:11.574494 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:22:11.575069 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.575826 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.583495 (+ 7669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.584535 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.584735 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.584821 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:11.585117 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 00:22:11.585256 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 00:22:11.585713 31490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.572051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:43817 (local address 127.18.163.193:52861)
0812 00:22:11.573960 (+ 1909us) negotiation.cc:107] Waiting for socket to connect
0812 00:22:11.573980 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:22:11.574171 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:22:11.574516 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:22:11.574520 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:22:11.574559 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:22:11.574885 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:11.574894 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.576047 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.576051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:11.583299 (+ 7248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:22:11.583318 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.584779 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.584786 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:22:11.584948 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.584974 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 00:22:11.585088 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 00:22:11.585250 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1768,"mutex_wait_us":520,"thread_start_us":769,"threads_started":1}
I20260812 00:22:11.586752 31249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8c7a0f1469a41c286491f36e5602905" candidate_uuid: "4212bdf9f22044e5a3d7f1861c4f4488" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb030e4d75948799103fef6e524c40e" is_pre_election: true
I20260812 00:22:11.588128 31018 leader_election.cc:302] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4212bdf9f22044e5a3d7f1861c4f4488; no voters: 19a48dfac4894106bf2b372f5d396a86, 3bb030e4d75948799103fef6e524c40e
I20260812 00:22:11.588655 31487 raft_consensus.cc:2726] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 00:22:11.589111 30928 catalog_manager.cc:5495] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bb030e4d75948799103fef6e524c40e (127.18.163.194). New cstate: current_term: 1 leader_uuid: "3bb030e4d75948799103fef6e524c40e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a48dfac4894106bf2b372f5d396a86" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb030e4d75948799103fef6e524c40e" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4212bdf9f22044e5a3d7f1861c4f4488" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260812 00:22:11.674454 31475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.668695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42896 (local address 127.18.163.194:43817)
0812 00:22:11.668924 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:11.668929 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:11.668950 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:22:11.669082 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:11.669086 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:11.669180 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:11.669319 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:22:11.669697 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.670497 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.671913 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.672376 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.672482 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.673032 (+ 550us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:22:11.673686 (+ 654us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:22:11.673810 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:11.673986 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 00:22:11.674083 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:22:11.683734 31406 raft_consensus.cc:1261] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86 [term 1 FOLLOWER]: Refusing update from remote peer 3bb030e4d75948799103fef6e524c40e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:22:11.683787 31099 raft_consensus.cc:1261] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488 [term 1 FOLLOWER]: Refusing update from remote peer 3bb030e4d75948799103fef6e524c40e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:22:11.684930 31484 consensus_queue.cc:1035] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4212bdf9f22044e5a3d7f1861c4f4488" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:22:11.685320 31493 consensus_queue.cc:1035] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a48dfac4894106bf2b372f5d396a86" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 40755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:22:11.720551 30928 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:22:11.720861 30928 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:22:11.725056 30928 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 58e7ea4ebf1d4f2ea0b71fc4ab27c34f: Sending DeleteTablet for 3 replicas of tablet a8c7a0f1469a41c286491f36e5602905
I20260812 00:22:11.726522 31074 tablet_service.cc:1514] Processing DeleteTablet for tablet a8c7a0f1469a41c286491f36e5602905 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:22:11 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:44860
I20260812 00:22:11.726482 31383 tablet_service.cc:1514] Processing DeleteTablet for tablet a8c7a0f1469a41c286491f36e5602905 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:22:11 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:43056
I20260812 00:22:11.727320 31222 tablet_service.cc:1514] Processing DeleteTablet for tablet a8c7a0f1469a41c286491f36e5602905 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:22:11 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:41264
I20260812 00:22:11.727562 31509 tablet_replica.cc:330] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86: stopping tablet replica
I20260812 00:22:11.728186 31509 raft_consensus.cc:2229] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:22:11.728987 31509 raft_consensus.cc:2258] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:22:11.732332 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 31000
I20260812 00:22:11.732568 31509 ts_tablet_manager.cc:1905] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:22:11.739025 31511 tablet_replica.cc:330] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e: stopping tablet replica
I20260812 00:22:11.739588 31511 raft_consensus.cc:2229] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:22:11.740607 31511 raft_consensus.cc:2258] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:22:11.743263 31511 ts_tablet_manager.cc:1905] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:22:11.744380 31509 ts_tablet_manager.cc:1918] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:22:11.744664 31509 log.cc:1196] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/a8c7a0f1469a41c286491f36e5602905
I20260812 00:22:11.745458 31509 ts_tablet_manager.cc:1939] T a8c7a0f1469a41c286491f36e5602905 P 19a48dfac4894106bf2b372f5d396a86: Deleting consensus metadata
I20260812 00:22:11.747893 31510 tablet_replica.cc:330] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488: stopping tablet replica
I20260812 00:22:11.748035 30912 catalog_manager.cc:4841] TS 19a48dfac4894106bf2b372f5d396a86 (127.18.163.195:40755): tablet a8c7a0f1469a41c286491f36e5602905 (table test-table [id=6b4c5ca9769d4fa6a86a50beda6164fb]) successfully deleted
I20260812 00:22:11.748683 31510 raft_consensus.cc:2229] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:22:11.749419 31510 raft_consensus.cc:2258] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:22:11.752569 31510 ts_tablet_manager.cc:1905] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 00:22:11 dist-test-slave-njxd krb5kdc[30877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:22:11.753180 31511 ts_tablet_manager.cc:1918] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:22:11.753453 31511 log.cc:1196] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/a8c7a0f1469a41c286491f36e5602905
I20260812 00:22:11.754158 31511 ts_tablet_manager.cc:1939] T a8c7a0f1469a41c286491f36e5602905 P 3bb030e4d75948799103fef6e524c40e: Deleting consensus metadata
I20260812 00:22:11.756524 30911 catalog_manager.cc:4841] TS 3bb030e4d75948799103fef6e524c40e (127.18.163.194:43817): tablet a8c7a0f1469a41c286491f36e5602905 (table test-table [id=6b4c5ca9769d4fa6a86a50beda6164fb]) successfully deleted
I20260812 00:22:11.761174 31510 ts_tablet_manager.cc:1918] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:22:11.761533 31510 log.cc:1196] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/a8c7a0f1469a41c286491f36e5602905
I20260812 00:22:11.762140 31477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.734083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34976 (local address 127.18.163.193:46257)
0812 00:22:11.734784 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:11.734791 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:11.741796 (+ 7005us) server_negotiation.cc:407] Connection header received
0812 00:22:11.742149 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:11.742157 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:11.742253 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:11.742351 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:11.744331 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.745609 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.747539 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.748303 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.748492 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.754602 (+ 6110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:11.754622 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:11.754641 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:22:11.754698 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:11.758630 (+ 3932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:22:11.759553 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:22:11.759568 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:22:11.759571 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:22:11.759769 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:22:11.760264 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:22:11.760274 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:22:11.760276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:22:11.760685 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:11.761079 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:11.761412 (+ 333us) server_negotiation.cc:299] Negotiation successful
0812 00:22:11.761706 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536}
I20260812 00:22:11.762288 31510 ts_tablet_manager.cc:1939] T a8c7a0f1469a41c286491f36e5602905 P 4212bdf9f22044e5a3d7f1861c4f4488: Deleting consensus metadata
I20260812 00:22:11.762912 31141 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:22:11.871083 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 31000
I20260812 00:22:11.871201 30910 catalog_manager.cc:4841] TS 4212bdf9f22044e5a3d7f1861c4f4488 (127.18.163.193:46257): tablet a8c7a0f1469a41c286491f36e5602905 (table test-table [id=6b4c5ca9769d4fa6a86a50beda6164fb]) successfully deleted
I20260812 00:22:11.894438 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 31155
Aug 12 00:22:11 dist-test-slave-njxd krb5kdc[30877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
I20260812 00:22:11.912703 31475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:11.895283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42910 (local address 127.18.163.194:43817)
0812 00:22:11.895483 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:11.895489 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:11.895529 (+ 40us) server_negotiation.cc:407] Connection header received
0812 00:22:11.895732 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:11.895740 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:11.895857 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:11.895972 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:11.897451 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.898698 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.900008 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:11.900469 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:11.900614 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:11.905783 (+ 5169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:11.905803 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:11.905821 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:22:11.905864 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:11.909191 (+ 3327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:22:11.910225 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:22:11.910234 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:22:11.910236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:22:11.910423 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:22:11.910879 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:22:11.910929 (+ 50us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:22:11.910933 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:22:11.911383 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:11.911743 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:11.912086 (+ 343us) server_negotiation.cc:299] Negotiation successful
0812 00:22:11.912355 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 00:22:11.913426 31290 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:22:12.038825 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 31155
I20260812 00:22:12.064352 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 31308
Aug 12 00:22:12 dist-test-slave-njxd krb5kdc[30877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:22:12.085610 31473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:22:12.065313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34442 (local address 127.18.163.195:40755)
0812 00:22:12.065599 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0812 00:22:12.065609 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:22:12.065635 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:22:12.065763 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:22:12.065771 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:22:12.065902 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:22:12.066027 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:22:12.067468 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:12.068755 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:12.070496 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:22:12.071385 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:22:12.071547 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:22:12.077095 (+ 5548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:22:12.077127 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:22:12.077156 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:22:12.077225 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:22:12.082003 (+ 4778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:22:12.082914 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:22:12.082929 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:22:12.082934 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:22:12.083155 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:22:12.083560 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:22:12.083568 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:22:12.083573 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:22:12.084115 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:22:12.084513 (+ 398us) server_negotiation.cc:1035] Waiting for connection context
0812 00:22:12.084754 (+ 241us) server_negotiation.cc:299] Negotiation successful
0812 00:22:12.085082 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 00:22:12.086416 31453 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:22:12.181332 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 31308
I20260812 00:22:12.206306 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 30892
I20260812 00:22:12.207643 30963 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:22:12.324752 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 30892
2026-08-12T00:22:12Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (5125 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:22:12 dist-test-slave-njxd krb5kdc[31519](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:22:12 dist-test-slave-njxd krb5kdc[31519](info): set up 2 sockets
Aug 12 00:22:12 dist-test-slave-njxd krb5kdc[31519](info): commencing operation
krb5kdc: starting...
W20260812 00:22:13.562750 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.187s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:22:13 dist-test-slave-njxd krb5kdc[31519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494133, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:22:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:22:13Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.18.163.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.18.163.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.18.163.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/rangeradmin_127.18.163.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.18.163.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/rangeradmin_127.18.163.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.18.163.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.18.163.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.18.163.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/rangerlookup_127.18.163.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.18.163.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/rangerlookup_127.18.163.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.163.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.18.163.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.163.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/HTTP_127.18.163.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.163.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/HTTP_127.18.163.212@KRBTEST.COM.keytab.
I20260812 00:22:14.061796 19087 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task0D7a9a/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/postgres -l logfile start
2026-08-12 00:22:16.772 UTC [31557] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 00:22:16.772 UTC [31557] LOG: listening on IPv4 address "127.18.163.212", port 54219
2026-08-12 00:22:16.776 UTC [31557] LOG: listening on Unix socket "/tmp/.s.PGSQL.54219"
2026-08-12 00:22:16.799 UTC [31559] LOG: database system was shut down at 2026-08-12 00:22:15 UTC
2026-08-12 00:22:16.803 UTC [31557] LOG: database system is ready to accept connections
I20260812 00:22:17.867255 19087 mini_postgres.cc:96] Postgres bound to 54219
2026-08-12 00:22:17.896 UTC [31569] FATAL: database "slave" does not exist
127.18.163.212:54219 - accepting connections
I20260812 00:22:17.897742 19087 mini_ranger.cc:161] Starting Ranger...
I20260812 00:22:17.936939 19087 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 00:22:18.463320 19087 mini_ranger.cc:87] Created ranger Postgres database
I20260812 00:22:18.463500 19087 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ranger-admin
2026-08-12 00:22:18,803 [I] DB FLAVOR :POSTGRES
2026-08-12 00:22:18,804 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:22:18,804 [I] Checking connection..
2026-08-12 00:22:18,804 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 00:22:19,095 [I] Checking connection passed.
2026-08-12 00:22:19,095 [I] --------- Verifying version history table ---------
2026-08-12 00:22:19,095 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:22:19,377 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:22:19,377 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:22:19,655 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:22:19,655 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 00:22:19,655 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 00:22:19.918 UTC [31638] WARNING: there is no transaction in progress
2026-08-12 00:22:19,927 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 00:22:19,927 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:22:20,203 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 00:22:20,203 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:22:20,203 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 00:22:20,466 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 00:22:20,721 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-njxd.c.gcp-upstream.internal','N') ;"
2026-08-12 00:22:20,994 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:22:21,249 [I] Table x_portal_user does not exist in database ranger
2026-08-12 00:22:21,249 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:22:21,530 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 00:22:21,530 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:22:21,809 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:22:22,075 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 00:22:22,075 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 00:22:23.168 UTC [31759] WARNING: there is no transaction in progress
2026-08-12 00:22:23.188 UTC [31759] WARNING: there is no transaction in progress
2026-08-12 00:22:23.209 UTC [31759] WARNING: there is no transaction in progress
2026-08-12 00:22:23.228 UTC [31759] WARNING: there is no transaction in progress
2026-08-12 00:22:23.245 UTC [31759] WARNING: there is no transaction in progress
2026-08-12 00:22:23.266 UTC [31759] WARNING: there is no transaction in progress
2026-08-12 00:22:23.332 UTC [31759] WARNING: there is no transaction in progress
2026-08-12 00:22:23.339 UTC [31759] WARNING: there is no transaction in progress
2026-08-12 00:22:23.354 UTC [31759] WARNING: there is no transaction in progress
2026-08-12 00:22:23.367 UTC [31759] WARNING: there is no transaction in progress
2026-08-12 00:22:23.379 UTC [31759] WARNING: there is no transaction in progress
2026-08-12 00:22:23.395 UTC [31759] WARNING: there is no transaction in progress
2026-08-12 00:22:23.405 UTC [31759] WARNING: there is no transaction in progress
2026-08-12 00:22:23.413 UTC [31759] WARNING: there is no transaction in progress
2026-08-12 00:22:23.421 UTC [31759] WARNING: there is no transaction in progress
2026-08-12 00:22:23.430 UTC [31759] WARNING: there is no transaction in progress
2026-08-12 00:22:24,198 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 00:22:24,199 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 00:22:24,477 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 00:22:24,477 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:22:24,764 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 00:22:24,764 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:22:25,052 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 00:22:25,053 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:22:25,343 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:22:25,630 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-njxd.c.gcp-upstream.internal';"
2026-08-12 00:22:25,887 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 00:22:25,888 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 00:22:26,149 [I] DB_PATCHES have already been applied
I20260812 00:22:26.156112 19087 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ranger-admin:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task0D7a9a/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 00:22:26.156251 19087 mini_ranger.cc:193] Using host: 127.18.163.212
I20260812 00:22:26.183990 19087 mini_ranger.cc:227] Ranger admin URL: http://127.18.163.212:58941
Aug 12, 2026 12:22:26 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:22:26 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:22:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 12:22:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 12:22:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 12:22:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 12:22:27 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 00:22:27.424430 19087 mini_ranger.cc:160] Time spent starting Ranger: real 9.527s user 0.004s sys 0.083s
Aug 12, 2026 12:22:50 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 12:22:50 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 12:22:50 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 12:22:50 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 12:22:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 12:22:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 12:22:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 12:22:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 12:22:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 12:22:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 12:22:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 12:22:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 12:22:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 12:22:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 12:22:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 12:22:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 12:22:50 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 12:22:51 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 00:22:52.252292 19087 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.18.163.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.18.163.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.18.163.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/rangerkms_127.18.163.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.18.163.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/rangerkms_127.18.163.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.163.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.18.163.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.163.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/HTTP_127.18.163.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.163.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/HTTP_127.18.163.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 00:22:52 dist-test-slave-njxd krb5kdc[31519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494172, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 00:22:52.516249 19087 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 00:22:52.550331 19087 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 00:22:53.491746 19087 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 00:22:53.491902 19087 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ranger-kms
I20260812 00:22:53.492060 19087 mini_ranger_kms.cc:227] Using postgres at 127.18.163.212:54219
2026-08-12 00:22:54,059 [I] DB FLAVOR :POSTGRES
2026-08-12 00:22:54,060 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:22:54,060 [I] Checking connection
2026-08-12 00:22:54,060 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 00:22:54,337 [I] connection success
2026-08-12 00:22:54,337 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 00:22:54,338 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 00:22:54,338 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 00:22:54,599 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 00:22:54,600 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:22:54,600 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 00:22:54,600 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:54219/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 00:22:54,909 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 00:22:55.442402 19087 mini_ranger_kms.cc:310] Created kms service
I20260812 00:22:55.663259 19087 mini_ranger_kms.cc:326] Created kudu user
I20260812 00:22:55.714056 19087 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 00:22:55 dist-test-slave-njxd krb5kdc[31519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494172, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
I20260812 00:22:56.190872 19087 mini_ranger_kms.cc:384] Added ranger policy
I20260812 00:22:56.191253 19087 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ranger-kms:/tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 00:22:56.191329 19087 mini_ranger_kms.cc:240] Using host: 127.18.163.212
I20260812 00:22:56.223472 19087 mini_ranger_kms.cc:276] Ranger KMS PID: 31967
I20260812 00:22:56.223723 19087 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.18.163.212:57363
Aug 12, 2026 12:22:57 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:22:57 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:22:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 12:22:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 12:22:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 12:22:57 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 00:22:58 dist-test-slave-njxd krb5kdc[31519](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786494178, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.163.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:22:58.840449 19087 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.324s user 0.143s sys 0.490s
I20260812 00:22:58.840845 19087 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 00:22:58.841074 19087 mini_ranger_kms.cc:401] 127.18.163.212:57363/kms/v1/keys
Aug 12 00:22:59 dist-test-slave-njxd krb5kdc[31519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494178, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.163.212@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
Aug 12 00:22:59 dist-test-slave-njxd krb5kdc[31519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494178, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.163.212@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
Aug 12 00:23:01 dist-test-slave-njxd krb5kdc[31519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:23:02.096246 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:38327
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:45519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:38327
--ranger_config_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.163.212:57363/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:23:02.496071 32024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:23:02.496430 32024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:23:02.496598 32024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:23:02.504791 32024 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:23:02.504930 32024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:23:02.505021 32024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:23:02.505144 32024 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:23:02.505236 32024 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:23:02.516419 32024 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:45519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/wal
--ranger_kms_url=127.18.163.212:57363/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:38327
--ranger_config_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:38327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:23:02.518075 32024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:23:02.519580 32024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:23:02.533351 32032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:23:02.533437 32031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:23:02.533387 32034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:23:02.534500 32024 server_base.cc:1034] running on GCE node
I20260812 00:23:02.535809 32024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:23:02.538353 32024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:23:02.539680 32024 hybrid_clock.cc:648] HybridClock initialized: now 1786494182539643 us; error 50 us; skew 500 ppm
I20260812 00:23:02.540107 32024 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:23:02 dist-test-slave-njxd krb5kdc[31519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494182, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:23:02.544338 32024 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:23:02.546136 32024 webserver.cc:460] Webserver started at http://127.18.163.254:39193/ using document root <none> and password file <none>
I20260812 00:23:02.546872 32024 fs_manager.cc:359] Metadata directory not provided
I20260812 00:23:02.547008 32024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:23:02.547353 32024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:23:02 dist-test-slave-njxd krb5kdc[31519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494182, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
I20260812 00:23:02.602684 32024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "1a7d0c54c4814ba9aa507d2ecc068c66"
format_stamp: "Formatted at 2026-08-12 00:23:02 on dist-test-slave-njxd"
server_key: "6c8c223eda709fb02760ccf78ad75418"
server_key_iv: "07db871680b67b3e7e81fe71ec36beb9"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:02.603866 32024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "1a7d0c54c4814ba9aa507d2ecc068c66"
format_stamp: "Formatted at 2026-08-12 00:23:02 on dist-test-slave-njxd"
server_key: "6c8c223eda709fb02760ccf78ad75418"
server_key_iv: "07db871680b67b3e7e81fe71ec36beb9"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:02.611541 32024 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260812 00:23:02.631706 32043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:23:02.633741 32024 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 00:23:02.633980 32024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "1a7d0c54c4814ba9aa507d2ecc068c66"
format_stamp: "Formatted at 2026-08-12 00:23:02 on dist-test-slave-njxd"
server_key: "6c8c223eda709fb02760ccf78ad75418"
server_key_iv: "07db871680b67b3e7e81fe71ec36beb9"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:02.634311 32024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:23:02.655895 32024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:23:02.662768 32024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:23:02.663280 32024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:23:02.687094 32024 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:38327
I20260812 00:23:02.687134 32097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:38327 every 8 connection(s)
I20260812 00:23:02.688651 32024 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:23:02.691370 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 32024
I20260812 00:23:02.691591 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:23:02.692248 19087 external_mini_cluster.cc:1428] Setting key 46a60814f05ab59a0d4ae6dda0fd7e32
I20260812 00:23:02.693115 32098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 00:23:02 dist-test-slave-njxd krb5kdc[31519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:23:02.708791 32098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66: Bootstrap starting.
I20260812 00:23:02.713788 32098 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66: Neither blocks nor log segments found. Creating new log.
I20260812 00:23:02.715309 32098 log.cc:824] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66: Log is configured to *not* fsync() on all Append() calls
I20260812 00:23:02.718492 32101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:02.694430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52528 (local address 127.18.163.254:38327)
0812 00:23:02.695301 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:02.695318 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:02.695373 (+ 55us) server_negotiation.cc:407] Connection header received
0812 00:23:02.697074 (+ 1701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:02.697105 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:02.697736 (+ 631us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:02.698241 (+ 505us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:23:02.699514 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:02.701772 (+ 2258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:02.703060 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:02.704147 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:02.704412 (+ 265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:02.708830 (+ 4418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:23:02.708843 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:23:02.708867 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:23:02.708935 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:23:02.713100 (+ 4165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:02.714170 (+ 1070us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:02.714185 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:02.714198 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:02.714458 (+ 260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:02.714901 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:02.714906 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:02.714909 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:02.715720 (+ 811us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:23:02.716114 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:02.716564 (+ 450us) server_negotiation.cc:299] Negotiation successful
0812 00:23:02.717183 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":350,"threads_started":1}
I20260812 00:23:02.719188 32098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66: No bootstrap required, opened a new log
I20260812 00:23:02.727928 32098 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a7d0c54c4814ba9aa507d2ecc068c66" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38327 } }
I20260812 00:23:02.728379 32098 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:23:02.728462 32098 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7d0c54c4814ba9aa507d2ecc068c66, State: Initialized, Role: FOLLOWER
I20260812 00:23:02.729067 32098 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a7d0c54c4814ba9aa507d2ecc068c66" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38327 } }
I20260812 00:23:02.729313 32098 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:23:02.729419 32098 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:23:02.729641 32098 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:23:02.732358 32098 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a7d0c54c4814ba9aa507d2ecc068c66" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38327 } }
I20260812 00:23:02.732978 32098 leader_election.cc:302] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a7d0c54c4814ba9aa507d2ecc068c66; no voters:
I20260812 00:23:02.733851 32098 leader_election.cc:288] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:23:02.734028 32103 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:23:02.734834 32103 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7d0c54c4814ba9aa507d2ecc068c66, State: Running, Role: LEADER
I20260812 00:23:02.735453 32103 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a7d0c54c4814ba9aa507d2ecc068c66" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38327 } }
I20260812 00:23:02.736220 32098 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:23:02.738626 32104 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a7d0c54c4814ba9aa507d2ecc068c66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a7d0c54c4814ba9aa507d2ecc068c66" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38327 } } }
I20260812 00:23:02.739702 32104 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [sys.catalog]: This master's current role is: LEADER
I20260812 00:23:02.739842 32105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a7d0c54c4814ba9aa507d2ecc068c66. Latest consensus state: current_term: 1 leader_uuid: "1a7d0c54c4814ba9aa507d2ecc068c66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a7d0c54c4814ba9aa507d2ecc068c66" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38327 } } }
I20260812 00:23:02.740494 32105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66 [sys.catalog]: This master's current role is: LEADER
I20260812 00:23:02.741860 32113 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:23:02.750860 32113 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:23:02.759467 32098 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 00:23:02.778122 32113 catalog_manager.cc:1347] Generated new cluster ID: cf2b12e6c56842968ffdfd6038a20131
I20260812 00:23:02.778328 32113 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:23:02.803471 32113 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:23:02.805855 32113 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:23:02.830920 32113 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66: Generated new TSK 0
I20260812 00:23:02.832257 32113 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:23:03.609362 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.163.212:57363/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:38327
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:45519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:23:03 dist-test-slave-njxd krb5kdc[31519](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786494183, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 00:23:04.101830 32147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:23:04.102269 32147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:23:04.102429 32147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:23:04.114833 32147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:23:04.115018 32147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:23:04.115233 32147 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:23:04.132144 32147 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:45519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.18.163.212:57363/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:38327
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:23:04.134188 32147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:23:04.136178 32147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:23:04.160169 32157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:23:04.163904 32158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:23:04.165560 32147 server_base.cc:1034] running on GCE node
W20260812 00:23:04.165961 32161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:23:04.166919 32147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:23:04.168385 32147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:23:04.169721 32147 hybrid_clock.cc:648] HybridClock initialized: now 1786494184169622 us; error 72 us; skew 500 ppm
I20260812 00:23:04.170159 32147 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:23:04 dist-test-slave-njxd krb5kdc[31519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494184, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:23:04.174642 32147 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:23:04.179081 32147 webserver.cc:460] Webserver started at http://127.18.163.193:41699/ using document root <none> and password file <none>
I20260812 00:23:04.179955 32147 fs_manager.cc:359] Metadata directory not provided
I20260812 00:23:04.180132 32147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:23:04.180513 32147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:23:04 dist-test-slave-njxd krb5kdc[31519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494184, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
I20260812 00:23:04.206811 32147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "fa506a8f25ed479293b019ec26087385"
format_stamp: "Formatted at 2026-08-12 00:23:04 on dist-test-slave-njxd"
server_key: "40ec66690396bc294be12638f5c98052"
server_key_iv: "57d0e85b37283381f720bf79a0ec0460"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:04.208431 32147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "fa506a8f25ed479293b019ec26087385"
format_stamp: "Formatted at 2026-08-12 00:23:04 on dist-test-slave-njxd"
server_key: "40ec66690396bc294be12638f5c98052"
server_key_iv: "57d0e85b37283381f720bf79a0ec0460"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:04.230088 32147 fs_manager.cc:691] Time spent creating directory manager: real 0.021s user 0.011s sys 0.007s
I20260812 00:23:04.259501 32171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:23:04.267306 32147 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.007s sys 0.000s
I20260812 00:23:04.267590 32147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "fa506a8f25ed479293b019ec26087385"
format_stamp: "Formatted at 2026-08-12 00:23:04 on dist-test-slave-njxd"
server_key: "40ec66690396bc294be12638f5c98052"
server_key_iv: "57d0e85b37283381f720bf79a0ec0460"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:04.267906 32147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:23:04.308203 32147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:23:04.314009 32147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:23:04.314384 32147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:23:04.315726 32147 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:23:04.318823 32147 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:23:04.318934 32147 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:23:04.319051 32147 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:23:04.319114 32147 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:23:04 dist-test-slave-njxd krb5kdc[31519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494183, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
I20260812 00:23:04.447188 32147 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:34341
I20260812 00:23:04.447096 32295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:34341 every 8 connection(s)
I20260812 00:23:04.448997 32147 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:23:04.452378 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 32147
I20260812 00:23:04.452630 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:23:04.453477 19087 external_mini_cluster.cc:1428] Setting key 6ac64c4329bc960361cb0c12dfe3aa78
Aug 12 00:23:04 dist-test-slave-njxd krb5kdc[31519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494184, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
I20260812 00:23:04.501897 32300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:04.455796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:33247 (local address 127.18.163.254:38327)
0812 00:23:04.458208 (+ 2412us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:04.458215 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:04.463123 (+ 4908us) server_negotiation.cc:407] Connection header received
0812 00:23:04.479529 (+ 16406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:04.479536 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:04.479657 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:04.479742 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:23:04.482387 (+ 2645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:04.483531 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:04.486230 (+ 2699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:04.486861 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:04.486966 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:04.491919 (+ 4953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:23:04.491926 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:23:04.491931 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:23:04.491977 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:23:04.497145 (+ 5168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:04.498553 (+ 1408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:04.498559 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:04.498562 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:04.498770 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:04.499421 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:04.499427 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:04.499430 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:04.499832 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:23:04.499975 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:04.501169 (+ 1194us) server_negotiation.cc:299] Negotiation successful
0812 00:23:04.501448 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2268,"thread_start_us":3580,"threads_started":1}
I20260812 00:23:04.503043 32299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:04.454852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:38327 (local address 127.18.163.193:33247)
0812 00:23:04.458826 (+ 3974us) negotiation.cc:107] Waiting for socket to connect
0812 00:23:04.458883 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 00:23:04.479043 (+ 20160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:23:04.480428 (+ 1385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:23:04.480442 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:23:04.481130 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:23:04.482110 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:04.482139 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:04.483860 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:04.483866 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:04.486027 (+ 2161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:04.486046 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:04.487374 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:04.487381 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:04.487741 (+ 360us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:04.488697 (+ 956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:23:04.488731 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:23:04.491562 (+ 2831us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:23:04.497447 (+ 5885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:23:04.497459 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:23:04.497482 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:23:04.498365 (+ 883us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:23:04.498956 (+ 591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:23:04.498960 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:23:04.498963 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:23:04.499272 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:23:04.500079 (+ 807us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:23:04.500088 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:23:04.500609 (+ 521us) client_negotiation.cc:769] Sending connection context
0812 00:23:04.500944 (+ 335us) client_negotiation.cc:240] Negotiation successful
0812 00:23:04.501516 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3618,"thread_start_us":3320,"threads_started":1}
I20260812 00:23:04.505342 32296 heartbeater.cc:347] Connected to a master server at 127.18.163.254:38327
I20260812 00:23:04.505759 32296 heartbeater.cc:464] Registering TS with master...
I20260812 00:23:04.506709 32296 heartbeater.cc:511] Master 127.18.163.254:38327 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
I20260812 00:23:04.509671 32061 ts_manager.cc:194] Registered new tserver with Master: fa506a8f25ed479293b019ec26087385 (127.18.163.193:34341)
I20260812 00:23:04.511924 32061 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:33247
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:23:04.554454 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.163.212:57363/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:38327
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:45519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:23:04 dist-test-slave-njxd krb5kdc[31519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494183, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
W20260812 00:23:05.101295 32303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:23:05.101677 32303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:23:05.101861 32303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:23:05.109838 32303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:23:05.110014 32303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:23:05.110196 32303 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:23:05.121253 32303 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:45519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.18.163.212:57363/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:38327
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:23:05.122982 32303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:23:05.124559 32303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:23:05.141371 32322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:23:05.141347 32320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:23:05.142374 32319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:23:05.143625 32303 server_base.cc:1034] running on GCE node
I20260812 00:23:05.144362 32303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:23:05.145619 32303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:23:05.146879 32303 hybrid_clock.cc:648] HybridClock initialized: now 1786494185146825 us; error 50 us; skew 500 ppm
I20260812 00:23:05.147271 32303 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:23:05 dist-test-slave-njxd krb5kdc[31519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494185, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:23:05.154455 32303 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:23:05.156483 32303 webserver.cc:460] Webserver started at http://127.18.163.194:34875/ using document root <none> and password file <none>
I20260812 00:23:05.157323 32303 fs_manager.cc:359] Metadata directory not provided
I20260812 00:23:05.157478 32303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:23:05.157886 32303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:23:05 dist-test-slave-njxd krb5kdc[31519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494185, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
I20260812 00:23:05.177066 32303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "1047a86033a54d298c06e9773cf4d51f"
format_stamp: "Formatted at 2026-08-12 00:23:05 on dist-test-slave-njxd"
server_key: "ae6ebbf59d49188db0f73e4c1c8d1c14"
server_key_iv: "05e058387e528f3be278446fe5a2d7eb"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:05.178103 32303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "1047a86033a54d298c06e9773cf4d51f"
format_stamp: "Formatted at 2026-08-12 00:23:05 on dist-test-slave-njxd"
server_key: "ae6ebbf59d49188db0f73e4c1c8d1c14"
server_key_iv: "05e058387e528f3be278446fe5a2d7eb"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:05.184285 32303 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:23:05.208957 32330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:23:05.211313 32303 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.006s sys 0.001s
I20260812 00:23:05.211545 32303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "1047a86033a54d298c06e9773cf4d51f"
format_stamp: "Formatted at 2026-08-12 00:23:05 on dist-test-slave-njxd"
server_key: "ae6ebbf59d49188db0f73e4c1c8d1c14"
server_key_iv: "05e058387e528f3be278446fe5a2d7eb"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:05.211822 32303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:23:05.232668 32303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:23:05.237632 32303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:23:05.237989 32303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:23:05.239156 32303 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:23:05.240837 32303 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:23:05.240947 32303 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:23:05.241128 32303 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:23:05.241205 32303 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:23:05.287441 32303 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:46223
I20260812 00:23:05.287447 32458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:46223 every 8 connection(s)
I20260812 00:23:05.288908 32303 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:23:05.297251 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 32303
I20260812 00:23:05.297451 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:23:05.298069 19087 external_mini_cluster.cc:1428] Setting key 844491dfb76332a79add146636a7363e
Aug 12 00:23:05 dist-test-slave-njxd krb5kdc[31519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494185, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:23:05.312893 32461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:05.291945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:40183 (local address 127.18.163.254:38327)
0812 00:23:05.292519 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:05.292526 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:05.293725 (+ 1199us) server_negotiation.cc:407] Connection header received
0812 00:23:05.295791 (+ 2066us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:05.295798 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:05.295917 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:05.296062 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:23:05.298337 (+ 2275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:05.299415 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:05.301539 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:05.302043 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:05.302275 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:05.306039 (+ 3764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:23:05.306044 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:23:05.306048 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:23:05.306091 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:23:05.309072 (+ 2981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:05.310139 (+ 1067us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:05.310144 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:05.310147 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:05.310291 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:05.310861 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:05.310874 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:05.310876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:05.311219 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:23:05.311409 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:05.312194 (+ 785us) server_negotiation.cc:299] Negotiation successful
0812 00:23:05.312478 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":298,"threads_started":1}
I20260812 00:23:05.314209 32462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:05.292590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:38327 (local address 127.18.163.194:40183)
0812 00:23:05.293496 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0812 00:23:05.293554 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 00:23:05.295446 (+ 1892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:23:05.296316 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:23:05.296326 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:23:05.296967 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:23:05.297987 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:05.298018 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:05.299639 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:05.299645 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:05.301348 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:05.301366 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:05.302317 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:05.302325 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:05.302626 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:05.303410 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:23:05.303435 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:23:05.305732 (+ 2297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:23:05.309285 (+ 3553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:23:05.309296 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:23:05.309318 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:23:05.309960 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:23:05.310425 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:23:05.310430 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:23:05.310433 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:23:05.310719 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:23:05.311368 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:23:05.311378 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:23:05.311776 (+ 398us) client_negotiation.cc:769] Sending connection context
0812 00:23:05.312081 (+ 305us) client_negotiation.cc:240] Negotiation successful
0812 00:23:05.312676 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":406,"threads_started":1}
I20260812 00:23:05.316007 32459 heartbeater.cc:347] Connected to a master server at 127.18.163.254:38327
I20260812 00:23:05.316427 32459 heartbeater.cc:464] Registering TS with master...
I20260812 00:23:05.317512 32459 heartbeater.cc:511] Master 127.18.163.254:38327 requested a full tablet report, sending...
I20260812 00:23:05.319466 32061 ts_manager.cc:194] Registered new tserver with Master: 1047a86033a54d298c06e9773cf4d51f (127.18.163.194:46223)
I20260812 00:23:05.320639 32061 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:40183
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
I20260812 00:23:05.378530 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.163.212:57363/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:38327
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:45519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:23:05.516364 32296 heartbeater.cc:503] Master 127.18.163.254:38327 was elected leader, sending a full tablet report...
W20260812 00:23:05.764595 32466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:23:05.764990 32466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:23:05.765170 32466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:23:05.773186 32466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:23:05.773380 32466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:23:05.773588 32466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:23:05.784287 32466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:45519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.18.163.212:57363/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:38327
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:23:05.785912 32466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:23:05.787410 32466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:23:05.802107 32472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:23:05.802078 32475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:23:05.802186 32473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:23:05.807230 32466 server_base.cc:1034] running on GCE node
I20260812 00:23:05.807933 32466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:23:05.809021 32466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:23:05.810284 32466 hybrid_clock.cc:648] HybridClock initialized: now 1786494185810233 us; error 53 us; skew 500 ppm
I20260812 00:23:05.810675 32466 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:23:05 dist-test-slave-njxd krb5kdc[31519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494185, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:23:05.814462 32466 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:23:05.816354 32466 webserver.cc:460] Webserver started at http://127.18.163.195:37517/ using document root <none> and password file <none>
I20260812 00:23:05.817245 32466 fs_manager.cc:359] Metadata directory not provided
I20260812 00:23:05.817384 32466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:23:05.817797 32466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:23:05 dist-test-slave-njxd krb5kdc[31519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494185, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
I20260812 00:23:05.834681 32466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "83f7e7e7bc514d549eef34fad980ff14"
format_stamp: "Formatted at 2026-08-12 00:23:05 on dist-test-slave-njxd"
server_key: "866641ff66ac08b8e0b99546f9cd588c"
server_key_iv: "28cd8685e9d874e6fe41a2fd3c2fc90d"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:05.835690 32466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "83f7e7e7bc514d549eef34fad980ff14"
format_stamp: "Formatted at 2026-08-12 00:23:05 on dist-test-slave-njxd"
server_key: "866641ff66ac08b8e0b99546f9cd588c"
server_key_iv: "28cd8685e9d874e6fe41a2fd3c2fc90d"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:05.842857 32466 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260812 00:23:05.858685 32485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:23:05.860615 32466 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 00:23:05.860894 32466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "83f7e7e7bc514d549eef34fad980ff14"
format_stamp: "Formatted at 2026-08-12 00:23:05 on dist-test-slave-njxd"
server_key: "866641ff66ac08b8e0b99546f9cd588c"
server_key_iv: "28cd8685e9d874e6fe41a2fd3c2fc90d"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:05.861196 32466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:23:05.887595 32466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:23:05.892453 32466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:23:05.892841 32466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:23:05.894088 32466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:23:05.895768 32466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:23:05.895857 32466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:23:05.896008 32466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:23:05.896061 32466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:23:05.935129 32466 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:42933
I20260812 00:23:05.935142 32607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:42933 every 8 connection(s)
I20260812 00:23:05.936776 32466 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:23:05.937237 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 32466
I20260812 00:23:05.937439 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:23:05.938163 19087 external_mini_cluster.cc:1428] Setting key ac4c6bd54c862292ca93bf6cd3e772a6
Aug 12 00:23:05 dist-test-slave-njxd krb5kdc[31519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494185, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:23:05.960907 32610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:05.940308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:58753 (local address 127.18.163.254:38327)
0812 00:23:05.942058 (+ 1750us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:05.942066 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:05.942606 (+ 540us) server_negotiation.cc:407] Connection header received
0812 00:23:05.944692 (+ 2086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:05.944698 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:05.944816 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:05.944956 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:23:05.946766 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:05.947511 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:05.949277 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:05.949829 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:05.949980 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:05.953798 (+ 3818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:23:05.953805 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:23:05.953809 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:23:05.953905 (+ 96us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:23:05.957115 (+ 3210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:05.958103 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:05.958108 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:05.958110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:05.958270 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:05.958813 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:05.958817 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:05.958819 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:05.959138 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:23:05.959350 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:05.960199 (+ 849us) server_negotiation.cc:299] Negotiation successful
0812 00:23:05.960491 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1596,"thread_start_us":1440,"threads_started":1}
I20260812 00:23:05.962154 32611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:05.941259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:38327 (local address 127.18.163.195:58753)
0812 00:23:05.942416 (+ 1157us) negotiation.cc:107] Waiting for socket to connect
0812 00:23:05.942460 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:23:05.944365 (+ 1905us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:23:05.945252 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:23:05.945263 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:23:05.945859 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:23:05.946541 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:05.946563 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:05.947726 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:05.947730 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:05.949072 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:05.949096 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:05.950169 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:05.950186 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:05.950422 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:05.951154 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:23:05.951185 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:23:05.953440 (+ 2255us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:23:05.957293 (+ 3853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:23:05.957302 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:23:05.957320 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:23:05.957963 (+ 643us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:23:05.958379 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:23:05.958383 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:23:05.958385 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:23:05.958635 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:23:05.959316 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:23:05.959327 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:23:05.959755 (+ 428us) client_negotiation.cc:769] Sending connection context
0812 00:23:05.960072 (+ 317us) client_negotiation.cc:240] Negotiation successful
0812 00:23:05.960698 (+ 626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":878,"thread_start_us":497,"threads_started":1}
I20260812 00:23:05.963967 32608 heartbeater.cc:347] Connected to a master server at 127.18.163.254:38327
I20260812 00:23:05.964313 32608 heartbeater.cc:464] Registering TS with master...
I20260812 00:23:05.965133 32608 heartbeater.cc:511] Master 127.18.163.254:38327 requested a full tablet report, sending...
I20260812 00:23:05.967185 32061 ts_manager.cc:194] Registered new tserver with Master: 83f7e7e7bc514d549eef34fad980ff14 (127.18.163.195:42933)
I20260812 00:23:05.968392 32061 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:58753
I20260812 00:23:05.969935 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:23:05.990710 32610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:05.975317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52542 (local address 127.18.163.254:38327)
0812 00:23:05.975586 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:05.975595 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:05.976011 (+ 416us) server_negotiation.cc:407] Connection header received
0812 00:23:05.976300 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:05.976305 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:05.976396 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:05.976513 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:23:05.978366 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:05.979137 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:05.980720 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:05.981177 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:05.981360 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:05.984321 (+ 2961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:23:05.984327 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:23:05.984330 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:23:05.984375 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:23:05.987518 (+ 3143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:05.988384 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:05.988397 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:05.988400 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:05.988551 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:05.989010 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:05.989018 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:05.989022 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:05.989361 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:23:05.989669 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:05.990083 (+ 414us) server_negotiation.cc:299] Negotiation successful
0812 00:23:05.990371 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 00:23:05.995468 32061 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52542:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:23:06.003271 32061 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:23:06.042266 32629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:06.019189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45178 (local address 127.18.163.194:46223)
0812 00:23:06.031571 (+ 12382us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:06.031584 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:06.031630 (+ 46us) server_negotiation.cc:407] Connection header received
0812 00:23:06.031775 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:06.031786 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:06.032162 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:06.034135 (+ 1973us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:23:06.034363 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.035725 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.038702 (+ 2977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.040408 (+ 1706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.040601 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:06.041509 (+ 908us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:06.041641 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 00:23:06.041847 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12121,"thread_start_us":11949,"threads_started":1}
I20260812 00:23:06.042295 32626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:06.018037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:46223 (local address 127.0.0.1:45178)
0812 00:23:06.028945 (+ 10908us) negotiation.cc:107] Waiting for socket to connect
0812 00:23:06.028998 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:23:06.029258 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:23:06.033137 (+ 3879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:23:06.033152 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:23:06.033251 (+ 99us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:23:06.033899 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:06.033918 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.035894 (+ 1976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.035899 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:06.038486 (+ 2587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:06.038502 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.040847 (+ 2345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.040855 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:06.041221 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:06.041309 (+ 88us) client_negotiation.cc:769] Sending connection context
0812 00:23:06.041440 (+ 131us) client_negotiation.cc:240] Negotiation successful
0812 00:23:06.041710 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10612,"mutex_wait_us":1,"spinlock_wait_cycles":3456,"thread_start_us":17577,"threads_started":1}
I20260812 00:23:06.046868 32627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:06.018585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:34341 (local address 127.0.0.1:33328)
0812 00:23:06.032973 (+ 14388us) negotiation.cc:107] Waiting for socket to connect
0812 00:23:06.033002 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:23:06.033218 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:23:06.035090 (+ 1872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:23:06.035095 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:23:06.035134 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:23:06.035599 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:06.035612 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.037829 (+ 2217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.037839 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:06.040299 (+ 2460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:06.040318 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.045619 (+ 5301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.045628 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:06.045994 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:06.046050 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 00:23:06.046304 (+ 254us) client_negotiation.cc:240] Negotiation successful
0812 00:23:06.046478 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14182,"thread_start_us":9852,"threads_started":1}
I20260812 00:23:06.047020 32628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:06.018751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33328 (local address 127.18.163.193:34341)
0812 00:23:06.034130 (+ 15379us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:06.034144 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:06.034189 (+ 45us) server_negotiation.cc:407] Connection header received
0812 00:23:06.034345 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:06.034359 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:06.034759 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:06.035083 (+ 324us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:23:06.035905 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.037653 (+ 1748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.040631 (+ 2978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.044141 (+ 3510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.044380 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:06.046339 (+ 1959us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:06.046447 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 00:23:06.046641 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15109,"thread_start_us":14801,"threads_started":1}
I20260812 00:23:06.046972 32625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:06.018781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:42933 (local address 127.0.0.1:47134)
0812 00:23:06.035967 (+ 17186us) negotiation.cc:107] Waiting for socket to connect
0812 00:23:06.035990 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:23:06.036463 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:23:06.037621 (+ 1158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:23:06.037629 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:23:06.037663 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:23:06.038266 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:06.038292 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.040247 (+ 1955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.040252 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:06.042627 (+ 2375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:06.042650 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.046090 (+ 3440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.046098 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:06.046294 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:06.046335 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 00:23:06.046420 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 00:23:06.046571 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17026,"thread_start_us":13784,"threads_started":1}
I20260812 00:23:06.047801 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:06.019554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47134 (local address 127.18.163.195:42933)
0812 00:23:06.032276 (+ 12722us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:06.032289 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:06.036282 (+ 3993us) server_negotiation.cc:407] Connection header received
0812 00:23:06.036706 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:06.036715 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:06.037064 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:06.037354 (+ 290us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:23:06.038517 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.039983 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.042883 (+ 2900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.045828 (+ 2945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.046065 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:06.046266 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:06.047166 (+ 900us) server_negotiation.cc:299] Negotiation successful
0812 00:23:06.047370 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12453,"thread_start_us":12210,"threads_started":1}
I20260812 00:23:06.048413 32388 tablet_service.cc:1467] Processing CreateTablet for tablet ae51fb8909374781bf2d9c9269cdd31d (DEFAULT_TABLE table=test-table [id=632ad88b79c34239b33db00c6134e5c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:23:06.050315 32388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae51fb8909374781bf2d9c9269cdd31d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:23:06.051530 32227 tablet_service.cc:1467] Processing CreateTablet for tablet ae51fb8909374781bf2d9c9269cdd31d (DEFAULT_TABLE table=test-table [id=632ad88b79c34239b33db00c6134e5c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:23:06.051838 32539 tablet_service.cc:1467] Processing CreateTablet for tablet ae51fb8909374781bf2d9c9269cdd31d (DEFAULT_TABLE table=test-table [id=632ad88b79c34239b33db00c6134e5c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:23:06.052964 32227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae51fb8909374781bf2d9c9269cdd31d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:23:06.053435 32539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae51fb8909374781bf2d9c9269cdd31d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:23:06.067903 32631 tablet_bootstrap.cc:492] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385: Bootstrap starting.
I20260812 00:23:06.069146 32632 tablet_bootstrap.cc:492] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f: Bootstrap starting.
I20260812 00:23:06.072309 32633 tablet_bootstrap.cc:492] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14: Bootstrap starting.
I20260812 00:23:06.073789 32632 tablet_bootstrap.cc:654] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f: Neither blocks nor log segments found. Creating new log.
I20260812 00:23:06.075352 32632 log.cc:824] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:23:06.075799 32631 tablet_bootstrap.cc:654] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385: Neither blocks nor log segments found. Creating new log.
I20260812 00:23:06.076601 32633 tablet_bootstrap.cc:654] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14: Neither blocks nor log segments found. Creating new log.
I20260812 00:23:06.077297 32631 log.cc:824] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385: Log is configured to *not* fsync() on all Append() calls
I20260812 00:23:06.078061 32633 log.cc:824] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14: Log is configured to *not* fsync() on all Append() calls
I20260812 00:23:06.079473 32632 tablet_bootstrap.cc:492] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f: No bootstrap required, opened a new log
I20260812 00:23:06.079990 32632 ts_tablet_manager.cc:1397] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.007s
I20260812 00:23:06.081473 32631 tablet_bootstrap.cc:492] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385: No bootstrap required, opened a new log
I20260812 00:23:06.081835 32631 ts_tablet_manager.cc:1397] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.000s
I20260812 00:23:06.082353 32633 tablet_bootstrap.cc:492] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14: No bootstrap required, opened a new log
I20260812 00:23:06.082659 32633 ts_tablet_manager.cc:1397] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260812 00:23:06.089949 32631 raft_consensus.cc:348] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1047a86033a54d298c06e9773cf4d51f" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 46223 } } peers { permanent_uuid: "fa506a8f25ed479293b019ec26087385" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34341 } } peers { permanent_uuid: "83f7e7e7bc514d549eef34fad980ff14" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 42933 } }
I20260812 00:23:06.090691 32631 raft_consensus.cc:374] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:23:06.090909 32631 raft_consensus.cc:729] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa506a8f25ed479293b019ec26087385, State: Initialized, Role: FOLLOWER
I20260812 00:23:06.091833 32631 consensus_queue.cc:260] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1047a86033a54d298c06e9773cf4d51f" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 46223 } } peers { permanent_uuid: "fa506a8f25ed479293b019ec26087385" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34341 } } peers { permanent_uuid: "83f7e7e7bc514d549eef34fad980ff14" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 42933 } }
I20260812 00:23:06.092008 32632 raft_consensus.cc:348] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1047a86033a54d298c06e9773cf4d51f" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 46223 } } peers { permanent_uuid: "fa506a8f25ed479293b019ec26087385" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34341 } } peers { permanent_uuid: "83f7e7e7bc514d549eef34fad980ff14" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 42933 } }
I20260812 00:23:06.092564 32632 raft_consensus.cc:374] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:23:06.092764 32632 raft_consensus.cc:729] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1047a86033a54d298c06e9773cf4d51f, State: Initialized, Role: FOLLOWER
I20260812 00:23:06.093751 32632 consensus_queue.cc:260] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1047a86033a54d298c06e9773cf4d51f" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 46223 } } peers { permanent_uuid: "fa506a8f25ed479293b019ec26087385" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34341 } } peers { permanent_uuid: "83f7e7e7bc514d549eef34fad980ff14" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 42933 } }
I20260812 00:23:06.095499 32631 ts_tablet_manager.cc:1428] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385: Time spent starting tablet: real 0.013s user 0.007s sys 0.004s
I20260812 00:23:06.095433 32633 raft_consensus.cc:348] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1047a86033a54d298c06e9773cf4d51f" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 46223 } } peers { permanent_uuid: "fa506a8f25ed479293b019ec26087385" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34341 } } peers { permanent_uuid: "83f7e7e7bc514d549eef34fad980ff14" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 42933 } }
I20260812 00:23:06.096221 32633 raft_consensus.cc:374] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:23:06.096710 32459 heartbeater.cc:503] Master 127.18.163.254:38327 was elected leader, sending a full tablet report...
I20260812 00:23:06.097486 32632 ts_tablet_manager.cc:1428] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f: Time spent starting tablet: real 0.017s user 0.012s sys 0.004s
I20260812 00:23:06.096390 32633 raft_consensus.cc:729] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83f7e7e7bc514d549eef34fad980ff14, State: Initialized, Role: FOLLOWER
I20260812 00:23:06.098919 32633 consensus_queue.cc:260] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1047a86033a54d298c06e9773cf4d51f" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 46223 } } peers { permanent_uuid: "fa506a8f25ed479293b019ec26087385" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34341 } } peers { permanent_uuid: "83f7e7e7bc514d549eef34fad980ff14" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 42933 } }
I20260812 00:23:06.099642 32639 raft_consensus.cc:482] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:23:06.099992 32639 raft_consensus.cc:504] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1047a86033a54d298c06e9773cf4d51f" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 46223 } } peers { permanent_uuid: "fa506a8f25ed479293b019ec26087385" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34341 } } peers { permanent_uuid: "83f7e7e7bc514d549eef34fad980ff14" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 42933 } }
I20260812 00:23:06.102046 32608 heartbeater.cc:503] Master 127.18.163.254:38327 was elected leader, sending a full tablet report...
I20260812 00:23:06.102454 32639 leader_election.cc:288] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1047a86033a54d298c06e9773cf4d51f (127.18.163.194:46223), fa506a8f25ed479293b019ec26087385 (127.18.163.193:34341)
I20260812 00:23:06.103097 32633 ts_tablet_manager.cc:1428] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14: Time spent starting tablet: real 0.020s user 0.014s sys 0.004s
I20260812 00:23:06.112457 32628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:06.104866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:41723 (local address 127.18.163.193:34341)
0812 00:23:06.105092 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:06.105098 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:06.105947 (+ 849us) server_negotiation.cc:407] Connection header received
0812 00:23:06.106241 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:06.106247 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:06.106332 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:06.106432 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:23:06.107032 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.108013 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.110511 (+ 2498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.111405 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.111557 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:06.111613 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:06.112002 (+ 389us) server_negotiation.cc:299] Negotiation successful
0812 00:23:06.112154 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:23:06.112501 32629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:06.104029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:60287 (local address 127.18.163.194:46223)
0812 00:23:06.104548 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:06.104557 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:06.104579 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:23:06.104660 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:06.104668 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:06.104806 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:06.104920 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:23:06.105798 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.106860 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.108930 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.110327 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.110527 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:06.110589 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:06.112060 (+ 1471us) server_negotiation.cc:299] Negotiation successful
0812 00:23:06.112232 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343}
I20260812 00:23:06.112514 32611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:06.103855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:46223 (local address 127.18.163.195:60287)
0812 00:23:06.104046 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:23:06.104069 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:23:06.104246 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:23:06.105194 (+ 948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:23:06.105203 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:23:06.105246 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:23:06.105509 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:06.105525 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.107071 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.107076 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:06.108743 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:06.108757 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.111715 (+ 2958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.111720 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:06.111874 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:06.111900 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 00:23:06.112021 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 00:23:06.112167 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60,"mutex_wait_us":23}
I20260812 00:23:06.112670 32641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:06.104367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:34341 (local address 127.18.163.195:41723)
0812 00:23:06.105835 (+ 1468us) negotiation.cc:107] Waiting for socket to connect
0812 00:23:06.105856 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:23:06.106072 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:23:06.106478 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:23:06.106485 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:23:06.106513 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:23:06.106843 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:06.106853 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.108185 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.108191 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:06.110303 (+ 2112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:06.110321 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.111635 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.111640 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:06.111801 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:06.111829 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 00:23:06.111961 (+ 132us) client_negotiation.cc:240] Negotiation successful
0812 00:23:06.112122 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1320,"mutex_wait_us":33,"thread_start_us":1826,"threads_started":1}
I20260812 00:23:06.113814 32411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae51fb8909374781bf2d9c9269cdd31d" candidate_uuid: "83f7e7e7bc514d549eef34fad980ff14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1047a86033a54d298c06e9773cf4d51f" is_pre_election: true
I20260812 00:23:06.113970 32248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae51fb8909374781bf2d9c9269cdd31d" candidate_uuid: "83f7e7e7bc514d549eef34fad980ff14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa506a8f25ed479293b019ec26087385" is_pre_election: true
I20260812 00:23:06.114424 32411 raft_consensus.cc:2454] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83f7e7e7bc514d549eef34fad980ff14 in term 0.
I20260812 00:23:06.114580 32248 raft_consensus.cc:2454] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83f7e7e7bc514d549eef34fad980ff14 in term 0.
I20260812 00:23:06.115347 32489 leader_election.cc:302] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1047a86033a54d298c06e9773cf4d51f, 83f7e7e7bc514d549eef34fad980ff14, fa506a8f25ed479293b019ec26087385; no voters:
I20260812 00:23:06.115883 32640 raft_consensus.cc:2781] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:23:06.116071 32640 raft_consensus.cc:482] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:23:06.116222 32640 raft_consensus.cc:3037] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:23:06.119071 32640 raft_consensus.cc:504] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1047a86033a54d298c06e9773cf4d51f" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 46223 } } peers { permanent_uuid: "fa506a8f25ed479293b019ec26087385" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34341 } } peers { permanent_uuid: "83f7e7e7bc514d549eef34fad980ff14" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 42933 } }
I20260812 00:23:06.119794 32640 leader_election.cc:288] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [CANDIDATE]: Term 1 election: Requested vote from peers 1047a86033a54d298c06e9773cf4d51f (127.18.163.194:46223), fa506a8f25ed479293b019ec26087385 (127.18.163.193:34341)
I20260812 00:23:06.120433 32248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae51fb8909374781bf2d9c9269cdd31d" candidate_uuid: "83f7e7e7bc514d549eef34fad980ff14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa506a8f25ed479293b019ec26087385"
I20260812 00:23:06.120406 32411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae51fb8909374781bf2d9c9269cdd31d" candidate_uuid: "83f7e7e7bc514d549eef34fad980ff14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1047a86033a54d298c06e9773cf4d51f"
I20260812 00:23:06.120682 32411 raft_consensus.cc:3037] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:23:06.120683 32248 raft_consensus.cc:3037] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:23:06.124343 32248 raft_consensus.cc:2454] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f7e7e7bc514d549eef34fad980ff14 in term 1.
I20260812 00:23:06.124343 32411 raft_consensus.cc:2454] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f7e7e7bc514d549eef34fad980ff14 in term 1.
I20260812 00:23:06.125025 32486 leader_election.cc:302] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1047a86033a54d298c06e9773cf4d51f, 83f7e7e7bc514d549eef34fad980ff14, fa506a8f25ed479293b019ec26087385; no voters:
I20260812 00:23:06.125468 32640 raft_consensus.cc:2781] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:23:06.125770 32640 raft_consensus.cc:686] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [term 1 LEADER]: Becoming Leader. State: Replica: 83f7e7e7bc514d549eef34fad980ff14, State: Running, Role: LEADER
I20260812 00:23:06.126336 32640 consensus_queue.cc:237] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1047a86033a54d298c06e9773cf4d51f" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 46223 } } peers { permanent_uuid: "fa506a8f25ed479293b019ec26087385" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34341 } } peers { permanent_uuid: "83f7e7e7bc514d549eef34fad980ff14" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 42933 } }
I20260812 00:23:06.132128 32060 catalog_manager.cc:5495] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83f7e7e7bc514d549eef34fad980ff14 (127.18.163.195). New cstate: current_term: 1 leader_uuid: "83f7e7e7bc514d549eef34fad980ff14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1047a86033a54d298c06e9773cf4d51f" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 46223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa506a8f25ed479293b019ec26087385" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f7e7e7bc514d549eef34fad980ff14" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 42933 } health_report { overall_health: HEALTHY } } }
I20260812 00:23:06.155889 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:06.149935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47144 (local address 127.18.163.195:42933)
0812 00:23:06.150132 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:06.150137 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:06.150242 (+ 105us) server_negotiation.cc:407] Connection header received
0812 00:23:06.150435 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:06.150440 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:06.150528 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:06.150673 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:23:06.151042 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.151778 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.153396 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.154007 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.154118 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:06.154715 (+ 597us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:23:06.155353 (+ 638us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:23:06.155484 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:06.155573 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 00:23:06.155654 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 00:23:06.165063 32248 raft_consensus.cc:1261] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385 [term 1 FOLLOWER]: Refusing update from remote peer 83f7e7e7bc514d549eef34fad980ff14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:23:06.165068 32411 raft_consensus.cc:1261] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f [term 1 FOLLOWER]: Refusing update from remote peer 83f7e7e7bc514d549eef34fad980ff14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:23:06.166215 32639 consensus_queue.cc:1035] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1047a86033a54d298c06e9773cf4d51f" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:23:06.166658 32640 consensus_queue.cc:1035] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa506a8f25ed479293b019ec26087385" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:23:06.179946 32644 mvcc.cc:205] Tried to move back new op lower bound from 7317480186520969216 to 7317480186378747904. Current Snapshot: MvccSnapshot[applied={T|T < 7317480186520969216}]
I20260812 00:23:06.199942 32061 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:23:06.200296 32061 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:23:06.204732 32061 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1a7d0c54c4814ba9aa507d2ecc068c66: Sending DeleteTablet for 3 replicas of tablet ae51fb8909374781bf2d9c9269cdd31d
I20260812 00:23:06.206303 32388 tablet_service.cc:1514] Processing DeleteTablet for tablet ae51fb8909374781bf2d9c9269cdd31d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:23:06 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:45178
I20260812 00:23:06.206312 32227 tablet_service.cc:1514] Processing DeleteTablet for tablet ae51fb8909374781bf2d9c9269cdd31d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:23:06 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:33328
I20260812 00:23:06.206321 32539 tablet_service.cc:1514] Processing DeleteTablet for tablet ae51fb8909374781bf2d9c9269cdd31d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:23:06 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:47134
I20260812 00:23:06.212276 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 32147
I20260812 00:23:06.220125 32655 tablet_replica.cc:330] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f: stopping tablet replica
I20260812 00:23:06.220326 32656 tablet_replica.cc:330] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385: stopping tablet replica
I20260812 00:23:06.220903 32656 raft_consensus.cc:2229] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:23:06.220896 32655 raft_consensus.cc:2229] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:23:06.221536 32656 raft_consensus.cc:2258] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:23:06.221536 32655 raft_consensus.cc:2258] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:23:06.223750 32657 tablet_replica.cc:330] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14: stopping tablet replica
I20260812 00:23:06.224251 32655 ts_tablet_manager.cc:1905] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:23:06.224339 32657 raft_consensus.cc:2229] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:23:06.225322 32657 raft_consensus.cc:2258] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:23:06.228084 32657 ts_tablet_manager.cc:1905] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:23:06.228570 32656 ts_tablet_manager.cc:1905] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 00:23:06 dist-test-slave-njxd krb5kdc[31519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:23:06.236348 32656 ts_tablet_manager.cc:1918] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:23:06.236349 32657 ts_tablet_manager.cc:1918] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:23:06.236567 32657 log.cc:1196] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/ae51fb8909374781bf2d9c9269cdd31d
I20260812 00:23:06.237295 32657 ts_tablet_manager.cc:1939] T ae51fb8909374781bf2d9c9269cdd31d P 83f7e7e7bc514d549eef34fad980ff14: Deleting consensus metadata
I20260812 00:23:06.239476 32045 catalog_manager.cc:4841] TS 83f7e7e7bc514d549eef34fad980ff14 (127.18.163.195:42933): tablet ae51fb8909374781bf2d9c9269cdd31d (table test-table [id=632ad88b79c34239b33db00c6134e5c4]) successfully deleted
I20260812 00:23:06.239605 32656 log.cc:1196] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/ae51fb8909374781bf2d9c9269cdd31d
I20260812 00:23:06.240309 32656 ts_tablet_manager.cc:1939] T ae51fb8909374781bf2d9c9269cdd31d P fa506a8f25ed479293b019ec26087385: Deleting consensus metadata
I20260812 00:23:06.242515 32655 ts_tablet_manager.cc:1918] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:23:06.242671 32046 catalog_manager.cc:4841] TS fa506a8f25ed479293b019ec26087385 (127.18.163.193:34341): tablet ae51fb8909374781bf2d9c9269cdd31d (table test-table [id=632ad88b79c34239b33db00c6134e5c4]) successfully deleted
I20260812 00:23:06.242789 32655 log.cc:1196] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/ae51fb8909374781bf2d9c9269cdd31d
I20260812 00:23:06.243377 32655 ts_tablet_manager.cc:1939] T ae51fb8909374781bf2d9c9269cdd31d P 1047a86033a54d298c06e9773cf4d51f: Deleting consensus metadata
I20260812 00:23:06.245379 32044 catalog_manager.cc:4841] TS 1047a86033a54d298c06e9773cf4d51f (127.18.163.194:46223): tablet ae51fb8909374781bf2d9c9269cdd31d (table test-table [id=632ad88b79c34239b33db00c6134e5c4]) successfully deleted
I20260812 00:23:06.246774 32628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:06.213931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33344 (local address 127.18.163.193:34341)
0812 00:23:06.214140 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:06.214148 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:06.222924 (+ 8776us) server_negotiation.cc:407] Connection header received
0812 00:23:06.223171 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:06.223177 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:06.223276 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:06.223397 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:23:06.226130 (+ 2733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.227439 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.229661 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.230423 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.230547 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:06.236987 (+ 6440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:23:06.237008 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:23:06.237030 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:23:06.237087 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:23:06.242902 (+ 5815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:06.244057 (+ 1155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:06.244068 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:06.244072 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:06.244273 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:06.244795 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:06.244801 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:06.244804 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:06.245377 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:23:06.245768 (+ 391us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:06.246119 (+ 351us) server_negotiation.cc:299] Negotiation successful
0812 00:23:06.246393 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 00:23:06.247548 32291 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:23:06.358369 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 32147
I20260812 00:23:06.381655 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 32303
Aug 12 00:23:06 dist-test-slave-njxd krb5kdc[31519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
I20260812 00:23:06.399008 32629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:06.382592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45182 (local address 127.18.163.194:46223)
0812 00:23:06.382788 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:06.382797 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:06.382837 (+ 40us) server_negotiation.cc:407] Connection header received
0812 00:23:06.383058 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:06.383063 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:06.383131 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:06.383248 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:23:06.384632 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.385398 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.386858 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.387276 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.387433 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:06.392454 (+ 5021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:23:06.392472 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:23:06.392489 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:23:06.392540 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:23:06.395743 (+ 3203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:06.396619 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:06.396628 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:06.396630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:06.396782 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:06.397211 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:06.397222 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:06.397225 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:06.397708 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:23:06.398019 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:06.398381 (+ 362us) server_negotiation.cc:299] Negotiation successful
0812 00:23:06.398624 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 00:23:06.399784 32454 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:23:06.493716 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 32303
I20260812 00:23:06.517136 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 32466
Aug 12 00:23:06 dist-test-slave-njxd krb5kdc[31519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:23:06.535909 32630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:06.518052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47154 (local address 127.18.163.195:42933)
0812 00:23:06.518254 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:06.518262 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:06.518338 (+ 76us) server_negotiation.cc:407] Connection header received
0812 00:23:06.518550 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:06.518556 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:06.518664 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:06.518781 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:23:06.520189 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.521019 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.522536 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:06.523026 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:06.523227 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:06.528700 (+ 5473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:23:06.528723 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:23:06.528740 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:23:06.528797 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:23:06.532227 (+ 3430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:06.533203 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:06.533212 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:06.533214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:06.533387 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:06.533997 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:06.534001 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:06.534003 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:06.534445 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:23:06.534850 (+ 405us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:06.535262 (+ 412us) server_negotiation.cc:299] Negotiation successful
0812 00:23:06.535519 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 00:23:06.536827 32603 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:23:06.666327 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 32466
I20260812 00:23:06.692521 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 32024
I20260812 00:23:06.693925 32093 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:23:06.812701 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 32024
I20260812 00:23:06.842612 19087 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 00:23:07.189417 19087 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 00:23:07.189808 19087 mini_ranger.cc:66] Stopping Ranger...
I20260812 00:23:07.547080 19087 mini_ranger.cc:68] Stopped Ranger
2026-08-12 00:23:07.547 UTC [31557] LOG: received smart shutdown request
2026-08-12 00:23:07.552 UTC [31557] LOG: background worker "logical replication launcher" (PID 31566) exited with exit code 1
2026-08-12 00:23:07.555 UTC [31560] LOG: shutting down
2026-08-12 00:23:07.761 UTC [31557] LOG: database system is shut down
2026-08-12T00:23:07Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (55579 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:23:08 dist-test-slave-njxd krb5kdc[32674](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:23:08 dist-test-slave-njxd krb5kdc[32674](info): set up 2 sockets
Aug 12 00:23:08 dist-test-slave-njxd krb5kdc[32674](info): commencing operation
krb5kdc: starting...
W20260812 00:23:09.130978 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:23:09 dist-test-slave-njxd krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494189, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:23:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:23:09Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.18.163.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.18.163.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.18.163.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/rangeradmin_127.18.163.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.18.163.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/rangeradmin_127.18.163.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.18.163.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.18.163.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.18.163.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/rangerlookup_127.18.163.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.18.163.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/rangerlookup_127.18.163.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.163.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.18.163.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.163.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/HTTP_127.18.163.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.163.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/HTTP_127.18.163.212@KRBTEST.COM.keytab.
I20260812 00:23:09.613795 19087 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task0D7a9a/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/postgres -l logfile start
2026-08-12 00:23:12.295 UTC [32708] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 00:23:12.295 UTC [32708] LOG: listening on IPv4 address "127.18.163.212", port 33651
2026-08-12 00:23:12.299 UTC [32708] LOG: listening on Unix socket "/tmp/.s.PGSQL.33651"
2026-08-12 00:23:12.322 UTC [32710] LOG: database system was shut down at 2026-08-12 00:23:10 UTC
2026-08-12 00:23:12.326 UTC [32708] LOG: database system is ready to accept connections
I20260812 00:23:13.394018 19087 mini_postgres.cc:96] Postgres bound to 33651
2026-08-12 00:23:13.420 UTC [32720] FATAL: database "slave" does not exist
127.18.163.212:33651 - accepting connections
I20260812 00:23:13.421744 19087 mini_ranger.cc:161] Starting Ranger...
I20260812 00:23:13.459779 19087 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 00:23:13.970602 19087 mini_ranger.cc:87] Created ranger Postgres database
I20260812 00:23:13.970736 19087 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-admin
2026-08-12 00:23:14,292 [I] DB FLAVOR :POSTGRES
2026-08-12 00:23:14,293 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:23:14,293 [I] Checking connection..
2026-08-12 00:23:14,293 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 00:23:14,572 [I] Checking connection passed.
2026-08-12 00:23:14,572 [I] --------- Verifying version history table ---------
2026-08-12 00:23:14,572 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:23:14,856 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:23:14,857 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:23:15,135 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:23:15,135 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 00:23:15,135 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 00:23:15.400 UTC [326] WARNING: there is no transaction in progress
2026-08-12 00:23:15,409 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 00:23:15,410 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:23:15,698 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 00:23:15,698 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:23:15,699 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 00:23:15,949 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 00:23:16,228 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-njxd.c.gcp-upstream.internal','N') ;"
2026-08-12 00:23:16,480 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:23:16,737 [I] Table x_portal_user does not exist in database ranger
2026-08-12 00:23:16,737 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:23:17,025 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 00:23:17,026 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:23:17,321 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:23:17,606 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 00:23:17,606 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 00:23:18.627 UTC [447] WARNING: there is no transaction in progress
2026-08-12 00:23:18.645 UTC [447] WARNING: there is no transaction in progress
2026-08-12 00:23:18.662 UTC [447] WARNING: there is no transaction in progress
2026-08-12 00:23:18.678 UTC [447] WARNING: there is no transaction in progress
2026-08-12 00:23:18.694 UTC [447] WARNING: there is no transaction in progress
2026-08-12 00:23:18.712 UTC [447] WARNING: there is no transaction in progress
2026-08-12 00:23:18.771 UTC [447] WARNING: there is no transaction in progress
2026-08-12 00:23:18.779 UTC [447] WARNING: there is no transaction in progress
2026-08-12 00:23:18.793 UTC [447] WARNING: there is no transaction in progress
2026-08-12 00:23:18.804 UTC [447] WARNING: there is no transaction in progress
2026-08-12 00:23:18.814 UTC [447] WARNING: there is no transaction in progress
2026-08-12 00:23:18.828 UTC [447] WARNING: there is no transaction in progress
2026-08-12 00:23:18.837 UTC [447] WARNING: there is no transaction in progress
2026-08-12 00:23:18.844 UTC [447] WARNING: there is no transaction in progress
2026-08-12 00:23:18.850 UTC [447] WARNING: there is no transaction in progress
2026-08-12 00:23:18.856 UTC [447] WARNING: there is no transaction in progress
2026-08-12 00:23:19,569 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 00:23:19,569 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 00:23:19,827 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 00:23:19,828 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:23:20,107 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 00:23:20,108 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:23:20,385 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 00:23:20,385 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:23:20,672 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:23:20,946 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-njxd.c.gcp-upstream.internal';"
2026-08-12 00:23:21,220 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 00:23:21,220 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 00:23:21,483 [I] DB_PATCHES have already been applied
I20260812 00:23:21.490360 19087 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-admin:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task0D7a9a/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 00:23:21.490463 19087 mini_ranger.cc:193] Using host: 127.18.163.212
I20260812 00:23:21.515343 19087 mini_ranger.cc:227] Ranger admin URL: http://127.18.163.212:53297
Aug 12, 2026 12:23:21 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:23:21 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:23:22 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 12:23:22 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 12:23:22 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 12:23:22 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 12:23:22 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 00:23:22.751824 19087 mini_ranger.cc:160] Time spent starting Ranger: real 9.330s user 0.001s sys 0.079s
Aug 12, 2026 12:23:44 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 12:23:44 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 12, 2026 12:23:44 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 12:23:44 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 12:23:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 12:23:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 12:23:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 12:23:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 12:23:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 12:23:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 12:23:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 12:23:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 12:23:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 12:23:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 12:23:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 12:23:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 12:23:44 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 12:23:45 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 00:23:45.750070 19087 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.18.163.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.18.163.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.18.163.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/rangerkms_127.18.163.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.18.163.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/rangerkms_127.18.163.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.163.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.18.163.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.163.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/HTTP_127.18.163.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.163.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/HTTP_127.18.163.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 00:23:45 dist-test-slave-njxd krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494225, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 00:23:46.000829 19087 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 00:23:46.032889 19087 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 00:23:46.861083 19087 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 00:23:46.861188 19087 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-kms
I20260812 00:23:46.861222 19087 mini_ranger_kms.cc:227] Using postgres at 127.18.163.212:33651
2026-08-12 00:23:47,257 [I] DB FLAVOR :POSTGRES
2026-08-12 00:23:47,257 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:23:47,258 [I] Checking connection
2026-08-12 00:23:47,258 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 00:23:47,522 [I] connection success
2026-08-12 00:23:47,522 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 00:23:47,522 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 00:23:47,523 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 00:23:47,787 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 00:23:47,787 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:23:47,787 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 00:23:47,788 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.163.212:33651/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 00:23:48,060 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 00:23:48.637398 19087 mini_ranger_kms.cc:310] Created kms service
I20260812 00:23:48.869951 19087 mini_ranger_kms.cc:326] Created kudu user
I20260812 00:23:48.921562 19087 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 00:23:48 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494225, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
I20260812 00:23:49.361663 19087 mini_ranger_kms.cc:384] Added ranger policy
I20260812 00:23:49.362004 19087 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-kms:/tmp/dist-test-task0D7a9a/build/asan/bin/postgresql.jar:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task0D7a9a/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 00:23:49.362048 19087 mini_ranger_kms.cc:240] Using host: 127.18.163.212
I20260812 00:23:49.388605 19087 mini_ranger_kms.cc:276] Ranger KMS PID: 643
I20260812 00:23:49.388759 19087 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.18.163.212:36823
Aug 12, 2026 12:23:50 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:23:50 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:23:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 12:23:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 12:23:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 12:23:50 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 00:23:51 dist-test-slave-njxd krb5kdc[32674](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786494231, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.163.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:23:51.841136 19087 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.840s user 0.104s sys 0.340s
I20260812 00:23:51.841406 19087 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 00:23:51.841632 19087 mini_ranger_kms.cc:401] 127.18.163.212:36823/kms/v1/keys
Aug 12 00:23:52 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494231, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.163.212@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
Aug 12 00:23:52 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494231, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.163.212@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
Aug 12 00:23:55 dist-test-slave-njxd krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494235, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:23:55.211464 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:45245
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:45245
--ranger_config_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.163.212:36823/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:23:55.588845 697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:23:55.589184 697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:23:55.589341 697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:23:55.597050 697 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:23:55.597193 697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:23:55.597288 697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:23:55.597393 697 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:23:55.597465 697 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:23:55.608953 697 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/wal
--ranger_kms_url=127.18.163.212:36823/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:45245
--ranger_config_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:45245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:23:55.610541 697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:23:55.612061 697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:23:55.626183 705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:23:55.626197 704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:23:55.628160 697 server_base.cc:1034] running on GCE node
W20260812 00:23:55.628299 707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:23:55.629302 697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:23:55.631163 697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:23:55.632460 697 hybrid_clock.cc:648] HybridClock initialized: now 1786494235632411 us; error 54 us; skew 500 ppm
I20260812 00:23:55.632867 697 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:23:55 dist-test-slave-njxd krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494235, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:23:55.641361 697 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:23:55.643481 697 webserver.cc:460] Webserver started at http://127.18.163.254:40243/ using document root <none> and password file <none>
I20260812 00:23:55.644272 697 fs_manager.cc:359] Metadata directory not provided
I20260812 00:23:55.644433 697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:23:55.644891 697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:23:55 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494235, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
I20260812 00:23:55.710181 697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "3a65d6f05aeb48aa9ddca2415e89b946"
format_stamp: "Formatted at 2026-08-12 00:23:55 on dist-test-slave-njxd"
server_key: "5d131c106440e5b459a8f1e71653748c"
server_key_iv: "4e31dc8aa67b059f0cf14d5d77bfe182"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:55.711148 697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "3a65d6f05aeb48aa9ddca2415e89b946"
format_stamp: "Formatted at 2026-08-12 00:23:55 on dist-test-slave-njxd"
server_key: "5d131c106440e5b459a8f1e71653748c"
server_key_iv: "4e31dc8aa67b059f0cf14d5d77bfe182"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:55.717303 697 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:23:55.739132 715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:23:55.740917 697 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 00:23:55.741155 697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "3a65d6f05aeb48aa9ddca2415e89b946"
format_stamp: "Formatted at 2026-08-12 00:23:55 on dist-test-slave-njxd"
server_key: "5d131c106440e5b459a8f1e71653748c"
server_key_iv: "4e31dc8aa67b059f0cf14d5d77bfe182"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:55.741412 697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:23:55.760402 697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:23:55.765129 697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:23:55.765506 697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:23:55.787755 697 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:45245
I20260812 00:23:55.787755 770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:45245 every 8 connection(s)
I20260812 00:23:55.789535 697 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:23:55.793991 771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:23:55.799728 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 697
I20260812 00:23:55.799975 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:23:55.800822 19087 external_mini_cluster.cc:1428] Setting key 7739363a4e6acf9e7382dbcd3c795ea6
I20260812 00:23:55.809669 771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946: Bootstrap starting.
I20260812 00:23:55.815791 771 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946: Neither blocks nor log segments found. Creating new log.
I20260812 00:23:55.817795 771 log.cc:824] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946: Log is configured to *not* fsync() on all Append() calls
I20260812 00:23:55.822540 771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946: No bootstrap required, opened a new log
I20260812 00:23:55.833696 771 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a65d6f05aeb48aa9ddca2415e89b946" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45245 } }
I20260812 00:23:55.834184 771 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
Aug 12 00:23:55 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494235, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:23:55.834324 771 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a65d6f05aeb48aa9ddca2415e89b946, State: Initialized, Role: FOLLOWER
I20260812 00:23:55.835131 771 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a65d6f05aeb48aa9ddca2415e89b946" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45245 } }
I20260812 00:23:55.835456 771 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:23:55.835685 771 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:23:55.835909 771 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:23:55.838914 771 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a65d6f05aeb48aa9ddca2415e89b946" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45245 } }
I20260812 00:23:55.839546 771 leader_election.cc:302] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a65d6f05aeb48aa9ddca2415e89b946; no voters:
I20260812 00:23:55.840364 771 leader_election.cc:288] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:23:55.840487 776 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:23:55.847747 774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:55.803448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56852 (local address 127.18.163.254:45245)
0812 00:23:55.818241 (+ 14793us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:55.818260 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:55.818323 (+ 63us) server_negotiation.cc:407] Connection header received
0812 00:23:55.821192 (+ 2869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:55.821230 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:55.821870 (+ 640us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:55.822403 (+ 533us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:23:55.824348 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:55.826595 (+ 2247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:55.828739 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:55.829959 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:55.830180 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:55.835834 (+ 5654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:23:55.835848 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:23:55.835877 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:23:55.835951 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:23:55.840579 (+ 4628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:55.841804 (+ 1225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:55.841814 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:55.841825 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:55.842046 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:55.842578 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:55.842583 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:55.842586 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:55.843523 (+ 937us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:23:55.845021 (+ 1498us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:55.845381 (+ 360us) server_negotiation.cc:299] Negotiation successful
0812 00:23:55.846000 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14501,"thread_start_us":14207,"threads_started":1}
I20260812 00:23:55.850199 771 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:23:55.852386 776 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [term 1 LEADER]: Becoming Leader. State: Replica: 3a65d6f05aeb48aa9ddca2415e89b946, State: Running, Role: LEADER
I20260812 00:23:55.853205 776 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a65d6f05aeb48aa9ddca2415e89b946" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45245 } }
I20260812 00:23:55.860869 777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a65d6f05aeb48aa9ddca2415e89b946. Latest consensus state: current_term: 1 leader_uuid: "3a65d6f05aeb48aa9ddca2415e89b946" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a65d6f05aeb48aa9ddca2415e89b946" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45245 } } }
I20260812 00:23:55.861336 777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [sys.catalog]: This master's current role is: LEADER
I20260812 00:23:55.863333 778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a65d6f05aeb48aa9ddca2415e89b946" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a65d6f05aeb48aa9ddca2415e89b946" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45245 } } }
I20260812 00:23:55.863694 778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [sys.catalog]: This master's current role is: LEADER
I20260812 00:23:55.872074 783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:23:55.878515 783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:23:55.889364 771 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 00:23:55.893229 783 catalog_manager.cc:1347] Generated new cluster ID: fffefdf01c844caba6f74b5bc08bf883
I20260812 00:23:55.893371 783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:23:55.937389 783 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:23:55.940588 783 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:23:55.953982 783 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946: Generated new TSK 0
I20260812 00:23:55.955152 783 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:23:56.785755 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.163.212:36823/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:45245
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:23:57 dist-test-slave-njxd krb5kdc[32674](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786494237, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 00:23:57.250576 820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:23:57.251119 820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:23:57.251325 820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:23:57.263711 820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:23:57.263906 820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:23:57.264166 820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:23:57.280984 820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.18.163.212:36823/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:45245
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:23:57.283179 820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:23:57.285190 820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:23:57.305591 831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:23:57.306322 832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:23:57.312785 835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:23:57.313437 820 server_base.cc:1034] running on GCE node
I20260812 00:23:57.314416 820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:23:57.315892 820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:23:57.317260 820 hybrid_clock.cc:648] HybridClock initialized: now 1786494237317144 us; error 112 us; skew 500 ppm
I20260812 00:23:57.317762 820 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:23:57 dist-test-slave-njxd krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494237, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:23:57.322598 820 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:23:57.324810 820 webserver.cc:460] Webserver started at http://127.18.163.193:39969/ using document root <none> and password file <none>
I20260812 00:23:57.325830 820 fs_manager.cc:359] Metadata directory not provided
I20260812 00:23:57.325995 820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:23:57.326395 820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:23:57 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494237, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
I20260812 00:23:57.349684 820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "8fd5e15188db422dbb063f2c01802a6c"
format_stamp: "Formatted at 2026-08-12 00:23:57 on dist-test-slave-njxd"
server_key: "a08740d8ef8cd08327cc6e6717719178"
server_key_iv: "42ad790679f5250e903d972d001ef3d8"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:57.351084 820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "8fd5e15188db422dbb063f2c01802a6c"
format_stamp: "Formatted at 2026-08-12 00:23:57 on dist-test-slave-njxd"
server_key: "a08740d8ef8cd08327cc6e6717719178"
server_key_iv: "42ad790679f5250e903d972d001ef3d8"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:57.374163 820 fs_manager.cc:691] Time spent creating directory manager: real 0.022s user 0.011s sys 0.008s
I20260812 00:23:57.408360 842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:23:57.410710 820 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.004s sys 0.004s
I20260812 00:23:57.410991 820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "8fd5e15188db422dbb063f2c01802a6c"
format_stamp: "Formatted at 2026-08-12 00:23:57 on dist-test-slave-njxd"
server_key: "a08740d8ef8cd08327cc6e6717719178"
server_key_iv: "42ad790679f5250e903d972d001ef3d8"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:57.411301 820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:23:57.436497 820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:23:57.443506 820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:23:57.443985 820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:23:57.445540 820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:23:57.498767 820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:23:57.498919 820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:23:57.499080 820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:23:57.499152 820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:23:57 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494237, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
I20260812 00:23:57.911428 820 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:40097
I20260812 00:23:57.911455 964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:40097 every 8 connection(s)
I20260812 00:23:57.913172 820 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:23:57.920001 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 820
I20260812 00:23:57.920254 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:23:57.921041 19087 external_mini_cluster.cc:1428] Setting key 8aad6af2c5a6faa90de6444d3d5bbb52
Aug 12 00:23:57 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494237, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:23:57.953733 970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:57.917427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:45245 (local address 127.18.163.193:48455)
0812 00:23:57.919174 (+ 1747us) negotiation.cc:107] Waiting for socket to connect
0812 00:23:57.919251 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0812 00:23:57.924815 (+ 5564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:23:57.930839 (+ 6024us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:23:57.930854 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:23:57.931630 (+ 776us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:23:57.932585 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:57.932618 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:57.934411 (+ 1793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:57.934417 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:57.936901 (+ 2484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:57.936927 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:57.938502 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:57.938512 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:57.938854 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:57.939785 (+ 931us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:23:57.939820 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:23:57.943019 (+ 3199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:23:57.947824 (+ 4805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:23:57.947836 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:23:57.947860 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:23:57.948639 (+ 779us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:23:57.949253 (+ 614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:23:57.949259 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:23:57.949262 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:23:57.949620 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:23:57.950484 (+ 864us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:23:57.950494 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:23:57.951031 (+ 537us) client_negotiation.cc:769] Sending connection context
0812 00:23:57.951426 (+ 395us) client_negotiation.cc:240] Negotiation successful
0812 00:23:57.952042 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1324,"thread_start_us":976,"threads_started":1}
I20260812 00:23:57.955138 969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:57.916774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:48455 (local address 127.18.163.254:45245)
0812 00:23:57.930142 (+ 13368us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:57.930147 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:57.930170 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:23:57.930234 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:57.930238 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:57.930309 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:57.930468 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:23:57.932896 (+ 2428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:57.934139 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:57.937205 (+ 3066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:57.937940 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:57.938110 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:57.943381 (+ 5271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:23:57.943389 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:23:57.943394 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:23:57.943444 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:23:57.947570 (+ 4126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:57.948864 (+ 1294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:57.948870 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:57.948874 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:57.949088 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:57.949791 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:57.949797 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:57.949800 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:57.950221 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:23:57.950379 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:57.954398 (+ 4019us) server_negotiation.cc:299] Negotiation successful
0812 00:23:57.954705 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13235,"thread_start_us":13039,"threads_started":1}
I20260812 00:23:57.957851 967 heartbeater.cc:347] Connected to a master server at 127.18.163.254:45245
I20260812 00:23:57.958252 967 heartbeater.cc:464] Registering TS with master...
I20260812 00:23:57.959299 967 heartbeater.cc:511] Master 127.18.163.254:45245 requested a full tablet report, sending...
I20260812 00:23:57.962460 734 ts_manager.cc:194] Registered new tserver with Master: 8fd5e15188db422dbb063f2c01802a6c (127.18.163.193:40097)
I20260812 00:23:57.964833 734 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:48455
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:23:58.008244 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.163.212:36823/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:45245
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:23:58 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494237, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
W20260812 00:23:58.478775 974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:23:58.479146 974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:23:58.479326 974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:23:58.487363 974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:23:58.487541 974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:23:58.487746 974 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:23:58.498391 974 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.18.163.212:36823/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:45245
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:23:58.499977 974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:23:58.501830 974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:23:58.516745 992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:23:58.516639 993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:23:58.517289 995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:23:58.517706 974 server_base.cc:1034] running on GCE node
I20260812 00:23:58.518445 974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:23:58.519619 974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:23:58.520862 974 hybrid_clock.cc:648] HybridClock initialized: now 1786494238520826 us; error 45 us; skew 500 ppm
I20260812 00:23:58.521260 974 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:23:58 dist-test-slave-njxd krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494238, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:23:58.524859 974 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:23:58.526851 974 webserver.cc:460] Webserver started at http://127.18.163.194:33335/ using document root <none> and password file <none>
I20260812 00:23:58.527648 974 fs_manager.cc:359] Metadata directory not provided
I20260812 00:23:58.527787 974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:23:58.528151 974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:23:58 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494238, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
I20260812 00:23:58.547263 974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a"
format_stamp: "Formatted at 2026-08-12 00:23:58 on dist-test-slave-njxd"
server_key: "71c50407ad54c05706f49653d75a75d5"
server_key_iv: "e11f1764d4bb4fc9e3b18c2fd5a5a455"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:58.548959 974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a"
format_stamp: "Formatted at 2026-08-12 00:23:58 on dist-test-slave-njxd"
server_key: "71c50407ad54c05706f49653d75a75d5"
server_key_iv: "e11f1764d4bb4fc9e3b18c2fd5a5a455"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:58.557953 974 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.000s
I20260812 00:23:58.578120 1003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.001s user 0.000s sys 0.000s
I20260812 00:23:58.579957 974 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260812 00:23:58.580184 974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a"
format_stamp: "Formatted at 2026-08-12 00:23:58 on dist-test-slave-njxd"
server_key: "71c50407ad54c05706f49653d75a75d5"
server_key_iv: "e11f1764d4bb4fc9e3b18c2fd5a5a455"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:58.580444 974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:23:58.612620 974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:23:58.617486 974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:23:58.617893 974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:23:58.619036 974 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:23:58.620746 974 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:23:58.620857 974 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:23:58.621024 974 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:23:58.621107 974 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:23:58.672497 974 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:44091
I20260812 00:23:58.672587 1130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:44091 every 8 connection(s)
I20260812 00:23:58.674160 974 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:23:58.680930 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 974
I20260812 00:23:58.681149 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:23:58.681922 19087 external_mini_cluster.cc:1428] Setting key 5bef2e2d877eea7d2cdebc79fd705fff
Aug 12 00:23:58 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494238, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:23:58.709731 1133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:58.677945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:57477 (local address 127.18.163.254:45245)
0812 00:23:58.686033 (+ 8088us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:58.686039 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:58.687651 (+ 1612us) server_negotiation.cc:407] Connection header received
0812 00:23:58.690128 (+ 2477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:58.690137 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:58.690243 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:58.690377 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:23:58.692454 (+ 2077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:58.693744 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:58.696214 (+ 2470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:58.696990 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:58.697167 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:58.701945 (+ 4778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:23:58.701953 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:23:58.701958 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:23:58.702015 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:23:58.705773 (+ 3758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:58.706869 (+ 1096us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:58.706876 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:58.706880 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:58.707054 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:58.707621 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:58.707627 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:58.707630 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:58.708010 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:23:58.708188 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:58.709092 (+ 904us) server_negotiation.cc:299] Negotiation successful
0812 00:23:58.709332 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7933,"thread_start_us":9459,"threads_started":1}
I20260812 00:23:58.711828 1134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:58.678798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:45245 (local address 127.18.163.194:57477)
0812 00:23:58.686882 (+ 8084us) negotiation.cc:107] Waiting for socket to connect
0812 00:23:58.686954 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0812 00:23:58.689768 (+ 2814us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:23:58.690696 (+ 928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:23:58.690709 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:23:58.691348 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:23:58.692242 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:58.692272 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:58.693984 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:58.693991 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:58.696024 (+ 2033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:58.696043 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:58.697287 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:58.697294 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:58.697648 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:58.698557 (+ 909us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:23:58.698591 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:23:58.701557 (+ 2966us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:23:58.705974 (+ 4417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:23:58.705986 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:23:58.706008 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:23:58.706693 (+ 685us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:23:58.707181 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:23:58.707186 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:23:58.707189 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:23:58.707483 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:23:58.708155 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:23:58.708165 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:23:58.708638 (+ 473us) client_negotiation.cc:769] Sending connection context
0812 00:23:58.708964 (+ 326us) client_negotiation.cc:240] Negotiation successful
0812 00:23:58.710375 (+ 1411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7738,"thread_start_us":7468,"threads_started":1}
I20260812 00:23:58.713634 1131 heartbeater.cc:347] Connected to a master server at 127.18.163.254:45245
I20260812 00:23:58.714010 1131 heartbeater.cc:464] Registering TS with master...
I20260812 00:23:58.714977 1131 heartbeater.cc:511] Master 127.18.163.254:45245 requested a full tablet report, sending...
I20260812 00:23:58.717007 734 ts_manager.cc:194] Registered new tserver with Master: 5d6a3327b24b4f43a1a160a3b5b3f88a (127.18.163.194:44091)
I20260812 00:23:58.718271 734 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:57477
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
I20260812 00:23:58.786065 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.163.212:36823/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:45245
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:23:58.969038 967 heartbeater.cc:503] Master 127.18.163.254:45245 was elected leader, sending a full tablet report...
W20260812 00:23:59.188457 1137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:23:59.188838 1137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:23:59.189015 1137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:23:59.196720 1137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:23:59.196914 1137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:23:59.197105 1137 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:23:59.207784 1137 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.18.163.212:36823/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:45245
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:23:59.209319 1137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:23:59.210882 1137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:23:59.226241 1143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:23:59.226339 1146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:23:59.226274 1144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:23:59.227254 1137 server_base.cc:1034] running on GCE node
I20260812 00:23:59.227988 1137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:23:59.229126 1137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:23:59.230378 1137 hybrid_clock.cc:648] HybridClock initialized: now 1786494239230328 us; error 44 us; skew 500 ppm
I20260812 00:23:59.230790 1137 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:23:59 dist-test-slave-njxd krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494239, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:23:59.234411 1137 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:23:59.236073 1137 webserver.cc:460] Webserver started at http://127.18.163.195:43787/ using document root <none> and password file <none>
I20260812 00:23:59.236851 1137 fs_manager.cc:359] Metadata directory not provided
I20260812 00:23:59.236999 1137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:23:59.237365 1137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:23:59 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494239, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
I20260812 00:23:59.257194 1137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "dfcc980944ec44dcb72fdde9dcca5be8"
format_stamp: "Formatted at 2026-08-12 00:23:59 on dist-test-slave-njxd"
server_key: "a6dd11d45872e44e08057efbd1de7cc8"
server_key_iv: "44589d20dc4698c9b3f1bcec561d442c"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:59.259186 1137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "dfcc980944ec44dcb72fdde9dcca5be8"
format_stamp: "Formatted at 2026-08-12 00:23:59 on dist-test-slave-njxd"
server_key: "a6dd11d45872e44e08057efbd1de7cc8"
server_key_iv: "44589d20dc4698c9b3f1bcec561d442c"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:59.267421 1137 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260812 00:23:59.286623 1153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:23:59.288545 1137 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 00:23:59.288762 1137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "dfcc980944ec44dcb72fdde9dcca5be8"
format_stamp: "Formatted at 2026-08-12 00:23:59 on dist-test-slave-njxd"
server_key: "a6dd11d45872e44e08057efbd1de7cc8"
server_key_iv: "44589d20dc4698c9b3f1bcec561d442c"
server_key_version: "kuduclusterkey@0"
I20260812 00:23:59.289045 1137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:23:59.348909 1137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:23:59.353422 1137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:23:59.353817 1137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:23:59.354893 1137 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:23:59.356457 1137 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:23:59.356539 1137 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:23:59.356634 1137 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:23:59.356679 1137 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:23:59.392598 1137 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:39751
I20260812 00:23:59.392643 1279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:39751 every 8 connection(s)
I20260812 00:23:59.394135 1137 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:23:59.401944 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 1137
I20260812 00:23:59.402143 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:23:59.402823 19087 external_mini_cluster.cc:1428] Setting key 8cf73bfe7258ce64222f54d1fbf456e2
Aug 12 00:23:59 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494239, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:23:59.416728 1284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:59.397040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:43245 (local address 127.18.163.254:45245)
0812 00:23:59.397630 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:59.397644 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:59.398689 (+ 1045us) server_negotiation.cc:407] Connection header received
0812 00:23:59.400509 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:59.400514 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:59.400599 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:59.400704 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:23:59.402553 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:59.403626 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:59.405953 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:59.406602 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:59.406750 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:59.410656 (+ 3906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:23:59.410662 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:23:59.410665 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:23:59.410703 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:23:59.413410 (+ 2707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:59.414442 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:59.414446 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:59.414448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:59.414616 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:59.415067 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:59.415070 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:59.415072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:59.415369 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:23:59.415495 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:59.416195 (+ 700us) server_negotiation.cc:299] Negotiation successful
0812 00:23:59.416388 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":261,"threads_started":1}
I20260812 00:23:59.418256 1285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:59.397683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:45245 (local address 127.18.163.195:43245)
0812 00:23:59.398466 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0812 00:23:59.398509 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:23:59.400226 (+ 1717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:23:59.400947 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:23:59.400956 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:23:59.401425 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:23:59.402335 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:59.402359 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:59.403805 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:59.403812 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:59.405803 (+ 1991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:23:59.405818 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:23:59.406908 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:23:59.406914 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:23:59.407154 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:59.407955 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:23:59.407982 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:23:59.410328 (+ 2346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:23:59.413694 (+ 3366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:23:59.413703 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:23:59.413720 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:23:59.414303 (+ 583us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:23:59.414722 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:23:59.414726 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:23:59.414728 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:23:59.414954 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:23:59.415480 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:23:59.415486 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:23:59.415847 (+ 361us) client_negotiation.cc:769] Sending connection context
0812 00:23:59.416096 (+ 249us) client_negotiation.cc:240] Negotiation successful
0812 00:23:59.416535 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":319,"threads_started":1}
I20260812 00:23:59.419859 1282 heartbeater.cc:347] Connected to a master server at 127.18.163.254:45245
I20260812 00:23:59.420152 1282 heartbeater.cc:464] Registering TS with master...
I20260812 00:23:59.420876 1282 heartbeater.cc:511] Master 127.18.163.254:45245 requested a full tablet report, sending...
I20260812 00:23:59.422420 734 ts_manager.cc:194] Registered new tserver with Master: dfcc980944ec44dcb72fdde9dcca5be8 (127.18.163.195:39751)
I20260812 00:23:59.423230 734 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:43245
I20260812 00:23:59.431864 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:23:59.433550 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 820
Aug 12 00:23:59 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494235, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:23:59.453274 1289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:59.434760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47604 (local address 127.18.163.193:40097)
0812 00:23:59.435498 (+ 738us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:59.435505 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:59.435533 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:23:59.435598 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:59.435605 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:59.435824 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:59.435960 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:23:59.437486 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:59.438686 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:59.440102 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:59.440716 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:59.440824 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:59.445785 (+ 4961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:23:59.445801 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:23:59.445833 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:23:59.445879 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:23:59.449626 (+ 3747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:59.450712 (+ 1086us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:59.450721 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:59.450723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:59.450895 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:59.451410 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:59.451417 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:59.451420 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:59.451944 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:23:59.452230 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:59.452704 (+ 474us) server_negotiation.cc:299] Negotiation successful
0812 00:23:59.452942 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":410,"threads_started":1}
I20260812 00:23:59.454777 959 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:23:59.540606 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 820
I20260812 00:23:59.563046 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 974
Aug 12 00:23:59 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494235, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
I20260812 00:23:59.580531 1291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:59.564000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44744 (local address 127.18.163.194:44091)
0812 00:23:59.564555 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:59.564562 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:59.564596 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:23:59.564660 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:59.564668 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:59.564894 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:59.565044 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:23:59.566417 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:59.567434 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:59.568873 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:59.569458 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:59.569565 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:59.574435 (+ 4870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:23:59.574451 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:23:59.574467 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:23:59.574512 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:23:59.577450 (+ 2938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:59.578390 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:59.578398 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:59.578400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:59.578540 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:59.578942 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:59.578945 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:59.578947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:59.579303 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:23:59.579551 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:59.579890 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 00:23:59.580110 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":290,"threads_started":1}
I20260812 00:23:59.582017 1126 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:23:59.668458 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 974
I20260812 00:23:59.694373 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 1137
Aug 12 00:23:59 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494235, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:23:59.712209 1293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:23:59.695536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39752 (local address 127.18.163.195:39751)
0812 00:23:59.696275 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0812 00:23:59.696283 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:23:59.696313 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:23:59.696378 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:23:59.696384 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:23:59.696619 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:23:59.696755 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:23:59.698209 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:59.699256 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:59.700525 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:23:59.701107 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:23:59.701217 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:23:59.706410 (+ 5193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:23:59.706424 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:23:59.706442 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:23:59.706484 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:23:59.709276 (+ 2792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:59.710137 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:59.710145 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:59.710147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:59.710289 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:23:59.710658 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:23:59.710661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:23:59.710664 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:23:59.711032 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:23:59.711283 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0812 00:23:59.711561 (+ 278us) server_negotiation.cc:299] Negotiation successful
0812 00:23:59.711790 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":425,"threads_started":1}
I20260812 00:23:59.713698 1275 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:23:59.799943 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 1137
I20260812 00:23:59.821223 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 697
I20260812 00:23:59.822654 765 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:23:59.936096 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 697
I20260812 00:23:59.966409 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:45245
--webserver_interface=127.18.163.254
--webserver_port=40243
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:45245
--ranger_config_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.163.212:36823/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.163.212:36823/kms with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:24:00.354024 1296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:00.354404 1296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:00.354588 1296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:00.362449 1296 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:24:00.362627 1296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:00.362736 1296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:00.362850 1296 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:24:00.362936 1296 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:24:00.373948 1296 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.163.212:36823/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:45245
--ranger_config_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:45245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=40243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:00.375478 1296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:00.376968 1296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:00.390074 1305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:00.390183 1301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:00.390249 1303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:00.390882 1296 server_base.cc:1034] running on GCE node
I20260812 00:24:00.391829 1296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:00.393438 1296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:00.394687 1296 hybrid_clock.cc:648] HybridClock initialized: now 1786494240394640 us; error 48 us; skew 500 ppm
I20260812 00:24:00.395088 1296 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:00 dist-test-slave-njxd krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494240, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:00.398538 1296 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:24:00.400164 1296 webserver.cc:460] Webserver started at http://127.18.163.254:40243/ using document root <none> and password file <none>
I20260812 00:24:00.400857 1296 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:00.400983 1296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:24:00 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494240, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
I20260812 00:24:00.487203 1296 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 00:24:00.490834 1314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:00.492550 1296 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 00:24:00.492800 1296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "3a65d6f05aeb48aa9ddca2415e89b946"
format_stamp: "Formatted at 2026-08-12 00:23:55 on dist-test-slave-njxd"
server_key: "5d131c106440e5b459a8f1e71653748c"
server_key_iv: "4e31dc8aa67b059f0cf14d5d77bfe182"
server_key_version: "kuduclusterkey@0"
I20260812 00:24:00.493988 1296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:00.542126 1296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:00.546347 1296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:00.546690 1296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:00.567631 1296 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:45245
I20260812 00:24:00.567665 1373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:45245 every 8 connection(s)
I20260812 00:24:00.569396 1296 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:24:00.575692 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 1296
I20260812 00:24:00.576624 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.163.212:36823/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:40097
--local_ip_for_outbound_sockets=127.18.163.193
--tserver_master_addrs=127.18.163.254:45245
--webserver_port=39969
--webserver_interface=127.18.163.193
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.163.212:36823/kms with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:24:00.577351 1374 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:24:00.581113 1374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946: Bootstrap starting.
I20260812 00:24:00.605553 1374 log.cc:824] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:00.619618 1374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:24:00.620345 1374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946: Bootstrap complete.
I20260812 00:24:00.634899 1374 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a65d6f05aeb48aa9ddca2415e89b946" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45245 } }
I20260812 00:24:00.636201 1374 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a65d6f05aeb48aa9ddca2415e89b946, State: Initialized, Role: FOLLOWER
I20260812 00:24:00.637048 1374 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a65d6f05aeb48aa9ddca2415e89b946" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45245 } }
I20260812 00:24:00.637351 1374 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:24:00.637490 1374 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:24:00.637738 1374 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:24:00.643738 1374 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a65d6f05aeb48aa9ddca2415e89b946" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45245 } }
I20260812 00:24:00.644420 1374 leader_election.cc:302] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a65d6f05aeb48aa9ddca2415e89b946; no voters:
I20260812 00:24:00.645169 1374 leader_election.cc:288] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:24:00.645372 1378 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:24:00.646656 1378 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [term 2 LEADER]: Becoming Leader. State: Replica: 3a65d6f05aeb48aa9ddca2415e89b946, State: Running, Role: LEADER
I20260812 00:24:00.647274 1378 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a65d6f05aeb48aa9ddca2415e89b946" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45245 } }
I20260812 00:24:00.647675 1374 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:24:00.650300 1379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3a65d6f05aeb48aa9ddca2415e89b946" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a65d6f05aeb48aa9ddca2415e89b946" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45245 } } }
I20260812 00:24:00.650754 1379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [sys.catalog]: This master's current role is: LEADER
I20260812 00:24:00.650384 1381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a65d6f05aeb48aa9ddca2415e89b946. Latest consensus state: current_term: 2 leader_uuid: "3a65d6f05aeb48aa9ddca2415e89b946" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a65d6f05aeb48aa9ddca2415e89b946" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 45245 } } }
I20260812 00:24:00.650915 1381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946 [sys.catalog]: This master's current role is: LEADER
I20260812 00:24:00.665300 1386 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:24:00.672147 1386 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:24:00.673933 1386 catalog_manager.cc:1259] Loaded cluster ID: fffefdf01c844caba6f74b5bc08bf883
I20260812 00:24:00.674158 1386 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:24:00.678898 1386 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:24:00.680915 1386 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946: Loaded TSK: 0
I20260812 00:24:00.682845 1386 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:24:00.688519 1374 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260812 00:24:01.125088 1376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:01.125562 1376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:01.125777 1376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:01.138792 1376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:01.138976 1376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:01.139195 1376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:24:01.156534 1376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.163.212:36823/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:40097
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=39969
--tserver_master_addrs=127.18.163.254:45245
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:01.158576 1376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:01.160563 1376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:01.177845 1419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:01.178505 1421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:01.179064 1418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:01.179196 1376 server_base.cc:1034] running on GCE node
I20260812 00:24:01.180070 1376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:01.181439 1376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:01.182696 1376 hybrid_clock.cc:648] HybridClock initialized: now 1786494241182629 us; error 56 us; skew 500 ppm
I20260812 00:24:01.183068 1376 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:01 dist-test-slave-njxd krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494241, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:01.189821 1376 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:24:01.192024 1376 webserver.cc:460] Webserver started at http://127.18.163.193:39969/ using document root <none> and password file <none>
I20260812 00:24:01.193053 1376 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:01.193261 1376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:24:01 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494241, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
I20260812 00:24:01.223527 1376 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.004s sys 0.000s
I20260812 00:24:01.230370 1429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:01.232512 1376 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.004s sys 0.004s
I20260812 00:24:01.232739 1376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "8fd5e15188db422dbb063f2c01802a6c"
format_stamp: "Formatted at 2026-08-12 00:23:57 on dist-test-slave-njxd"
server_key: "a08740d8ef8cd08327cc6e6717719178"
server_key_iv: "42ad790679f5250e903d972d001ef3d8"
server_key_version: "kuduclusterkey@0"
I20260812 00:24:01.234293 1376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:01.292462 1376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:01.298311 1376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:01.298661 1376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:01.300885 1376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:24:01.303612 1376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:24:01.303773 1376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:01.303929 1376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:24:01.304033 1376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:01.343952 1376 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:40097
I20260812 00:24:01.344072 1555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:40097 every 8 connection(s)
I20260812 00:24:01.345625 1376 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:24:01.347180 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 1376
I20260812 00:24:01.348318 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.163.212:36823/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:44091
--local_ip_for_outbound_sockets=127.18.163.194
--tserver_master_addrs=127.18.163.254:45245
--webserver_port=33335
--webserver_interface=127.18.163.194
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.163.212:36823/kms with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:24:01 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494241, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:24:01.396704 1558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:01.350217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:45245 (local address 127.18.163.193:56295)
0812 00:24:01.361670 (+ 11453us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:01.361773 (+ 103us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:01.365529 (+ 3756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:01.370231 (+ 4702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:01.370248 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:01.371195 (+ 947us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:01.372353 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:01.372391 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:01.375957 (+ 3566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:01.375966 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:01.378374 (+ 2408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:01.378402 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:01.380621 (+ 2219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:01.380631 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:01.380993 (+ 362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:01.381928 (+ 935us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:01.381965 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:01.385212 (+ 3247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:01.390396 (+ 5184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:01.390409 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:01.390430 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:01.391219 (+ 789us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:01.391968 (+ 749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:01.391975 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:01.391981 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:01.392333 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:01.393625 (+ 1292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:01.393635 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:01.394110 (+ 475us) client_negotiation.cc:769] Sending connection context
0812 00:24:01.394484 (+ 374us) client_negotiation.cc:240] Negotiation successful
0812 00:24:01.395154 (+ 670us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10926,"thread_start_us":10588,"threads_started":1}
I20260812 00:24:01.399919 1559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:01.351166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:56295 (local address 127.18.163.254:45245)
0812 00:24:01.366365 (+ 15199us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:01.366396 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:01.366480 (+ 84us) server_negotiation.cc:407] Connection header received
0812 00:24:01.367776 (+ 1296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:01.367804 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:01.368508 (+ 704us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:01.369104 (+ 596us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:01.373502 (+ 4398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:01.375691 (+ 2189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:01.378642 (+ 2951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:01.379874 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:01.380145 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:01.385687 (+ 5542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:01.385709 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:01.385737 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:01.385809 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:01.390124 (+ 4315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:01.391489 (+ 1365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:01.391503 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:01.391516 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:01.391791 (+ 275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:01.392506 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:01.392514 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:01.392519 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:01.393385 (+ 866us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:01.393691 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:01.397772 (+ 4081us) server_negotiation.cc:299] Negotiation successful
0812 00:24:01.398350 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14753,"thread_start_us":14762,"threads_started":1}
I20260812 00:24:01.404230 1556 heartbeater.cc:347] Connected to a master server at 127.18.163.254:45245
I20260812 00:24:01.404623 1556 heartbeater.cc:464] Registering TS with master...
I20260812 00:24:01.405675 1556 heartbeater.cc:511] Master 127.18.163.254:45245 requested a full tablet report, sending...
W20260812 00:24:01.409850 1556 heartbeater.cc:644] Failed to heartbeat to 127.18.163.254:45245 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 00:24:01.410126 1556 heartbeater.cc:464] Registering TS with master...
I20260812 00:24:01.410465 1556 heartbeater.cc:511] Master 127.18.163.254:45245 requested a full tablet report, sending...
I20260812 00:24:01.412220 1556 heartbeater.cc:464] Registering TS with master...
I20260812 00:24:01.412539 1556 heartbeater.cc:511] Master 127.18.163.254:45245 requested a full tablet report, sending...
W20260812 00:24:01.413968 1556 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:24:01.799641 1560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:01.799993 1560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:01.800163 1560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:01.808020 1560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:01.808197 1560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:01.808385 1560 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:24:01.822374 1560 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.163.212:36823/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:44091
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=33335
--tserver_master_addrs=127.18.163.254:45245
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:01.824432 1560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:01.826467 1560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:01.848349 1574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:01.854027 1575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:01.855574 1579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:01.856489 1560 server_base.cc:1034] running on GCE node
I20260812 00:24:01.857347 1560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:01.858613 1560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:01.859929 1560 hybrid_clock.cc:648] HybridClock initialized: now 1786494241859836 us; error 91 us; skew 500 ppm
I20260812 00:24:01.860287 1560 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:01 dist-test-slave-njxd krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494241, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:01.863967 1560 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:24:01.866952 1560 webserver.cc:460] Webserver started at http://127.18.163.194:33335/ using document root <none> and password file <none>
I20260812 00:24:01.867775 1560 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:01.867959 1560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:24:01 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494241, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
I20260812 00:24:01.896773 1560 fs_manager.cc:709] Time spent opening directory manager: real 0.010s user 0.007s sys 0.000s
I20260812 00:24:01.907033 1586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:01.909439 1560 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.005s sys 0.003s
I20260812 00:24:01.909811 1560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a"
format_stamp: "Formatted at 2026-08-12 00:23:58 on dist-test-slave-njxd"
server_key: "71c50407ad54c05706f49653d75a75d5"
server_key_iv: "e11f1764d4bb4fc9e3b18c2fd5a5a455"
server_key_version: "kuduclusterkey@0"
I20260812 00:24:01.911640 1560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:01.945081 1560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:01.951298 1560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:01.951758 1560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:01.962982 1560 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:24:01.969090 1560 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:24:01.969310 1560 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 00:24:01.969478 1560 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:24:01.969620 1560 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:02.013341 1560 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:44091
I20260812 00:24:02.013434 1716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:44091 every 8 connection(s)
I20260812 00:24:02.015460 1560 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:24:02.023736 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 1560
I20260812 00:24:02.024844 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.163.212:36823/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:39751
--local_ip_for_outbound_sockets=127.18.163.195
--tserver_master_addrs=127.18.163.254:45245
--webserver_port=43787
--webserver_interface=127.18.163.195
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.163.212:36823/kms with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:24:02 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494241, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
Aug 12 00:24:02 dist-test-slave-njxd krb5kdc[32674](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786494242, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:02.059037 1719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:02.018732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:46665 (local address 127.18.163.254:45245)
0812 00:24:02.035131 (+ 16399us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:02.035137 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:02.035161 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:24:02.035233 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:02.035238 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:02.035340 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:02.035472 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:02.038106 (+ 2634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.039256 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.042296 (+ 3040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.043079 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.043207 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:02.048947 (+ 5740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:02.048958 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:02.048966 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:02.049025 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:02.053296 (+ 4271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:02.055117 (+ 1821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:02.055127 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:02.055133 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:02.055358 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:02.056049 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:02.056057 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:02.056063 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:02.056519 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:02.056860 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:02.058163 (+ 1303us) server_negotiation.cc:299] Negotiation successful
0812 00:24:02.058503 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16236,"thread_start_us":16863,"threads_started":1}
I20260812 00:24:02.064221 1721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:02.019310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:45245 (local address 127.18.163.194:46665)
0812 00:24:02.030090 (+ 10780us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:02.030167 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:02.032768 (+ 2601us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:02.036101 (+ 3333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:02.036116 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:02.036839 (+ 723us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:02.037814 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:02.037847 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.039772 (+ 1925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.039779 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:02.042069 (+ 2290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:02.042091 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.043626 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.043636 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:02.043982 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:02.044938 (+ 956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:02.044976 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:02.048620 (+ 3644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:02.053534 (+ 4914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:02.053547 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:02.053600 (+ 53us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:02.054942 (+ 1342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:02.055574 (+ 632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:02.055578 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:02.055583 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:02.055903 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:02.057001 (+ 1098us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:02.057014 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:02.057622 (+ 608us) client_negotiation.cc:769] Sending connection context
0812 00:24:02.059741 (+ 2119us) client_negotiation.cc:240] Negotiation successful
0812 00:24:02.060503 (+ 762us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10395,"thread_start_us":10118,"threads_started":1}
I20260812 00:24:02.066593 1717 heartbeater.cc:347] Connected to a master server at 127.18.163.254:45245
I20260812 00:24:02.066967 1717 heartbeater.cc:464] Registering TS with master...
I20260812 00:24:02.068003 1717 heartbeater.cc:511] Master 127.18.163.254:45245 requested a full tablet report, sending...
I20260812 00:24:02.076059 1333 ts_manager.cc:194] Registered new tserver with Master: 5d6a3327b24b4f43a1a160a3b5b3f88a (127.18.163.194:44091)
I20260812 00:24:02.078415 1333 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:46665
I20260812 00:24:02.414147 1556 heartbeater.cc:464] Registering TS with master...
I20260812 00:24:02.414692 1556 heartbeater.cc:511] Master 127.18.163.254:45245 requested a full tablet report, sending...
I20260812 00:24:02.416215 1333 ts_manager.cc:194] Registered new tserver with Master: 8fd5e15188db422dbb063f2c01802a6c (127.18.163.193:40097)
I20260812 00:24:02.417495 1333 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:56295
W20260812 00:24:02.478775 1722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:02.479245 1722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:02.479440 1722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:02.488082 1722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:02.488271 1722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:02.488466 1722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:24:02.502331 1722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.163.212:36823/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:39751
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=43787
--tserver_master_addrs=127.18.163.254:45245
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:02.504297 1722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:02.506356 1722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 12 00:24:02 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494242, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
W20260812 00:24:02.539372 1729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:02.539389 1728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:02.546839 1731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:02.550199 1722 server_base.cc:1034] running on GCE node
I20260812 00:24:02.551146 1722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:02.562747 1722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:02.566274 1722 hybrid_clock.cc:648] HybridClock initialized: now 1786494242566140 us; error 100 us; skew 500 ppm
I20260812 00:24:02.566902 1722 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:02 dist-test-slave-njxd krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494242, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:02.571915 1722 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:24:02.618140 1722 webserver.cc:460] Webserver started at http://127.18.163.195:43787/ using document root <none> and password file <none>
I20260812 00:24:02.619385 1722 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:02.619647 1722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:24:02 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494242, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
I20260812 00:24:02.651505 1722 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.004s sys 0.000s
I20260812 00:24:02.655726 1740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:02.657768 1722 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.006s sys 0.000s
I20260812 00:24:02.658037 1722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "dfcc980944ec44dcb72fdde9dcca5be8"
format_stamp: "Formatted at 2026-08-12 00:23:59 on dist-test-slave-njxd"
server_key: "a6dd11d45872e44e08057efbd1de7cc8"
server_key_iv: "44589d20dc4698c9b3f1bcec561d442c"
server_key_version: "kuduclusterkey@0"
I20260812 00:24:02.659577 1722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:02.685527 1722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:02.691643 1722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:02.691994 1722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:02.693405 1722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:24:02.695540 1722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:24:02.695672 1722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:02.695802 1722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:24:02.695878 1722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:02.763288 1722 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:39751
I20260812 00:24:02.763384 1868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:39751 every 8 connection(s)
I20260812 00:24:02.765385 1722 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:24:02.772716 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 1722
Aug 12 00:24:02 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494242, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:24:02.814083 1876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:02.773919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54412 (local address 127.18.163.254:45245)
0812 00:24:02.787347 (+ 13428us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:02.787353 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:02.787989 (+ 636us) server_negotiation.cc:407] Connection header received
0812 00:24:02.788167 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:02.788173 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:02.788271 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:02.788398 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:02.790591 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.791742 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.793711 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.794478 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.794648 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:02.800152 (+ 5504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:02.800159 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:02.800164 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:02.800216 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:02.806864 (+ 6648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:02.808892 (+ 2028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:02.808897 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:02.808901 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:02.809096 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:02.809841 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:02.809847 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:02.809850 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:02.810299 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:02.810617 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:02.813278 (+ 2661us) server_negotiation.cc:299] Negotiation successful
0812 00:24:02.813638 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13279,"thread_start_us":13116,"threads_started":1}
I20260812 00:24:02.822991 1873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:02.770417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:57551 (local address 127.18.163.254:45245)
0812 00:24:02.782181 (+ 11764us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:02.782192 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:02.782233 (+ 41us) server_negotiation.cc:407] Connection header received
0812 00:24:02.786792 (+ 4559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:02.786798 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:02.786926 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:02.787066 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:02.797427 (+ 10361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.799895 (+ 2468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.803724 (+ 3829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.804542 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.804696 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:02.813999 (+ 9303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:02.814007 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:02.814011 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:02.814081 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:02.818384 (+ 4303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:02.819620 (+ 1236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:02.819627 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:02.819630 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:02.819808 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:02.820540 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:02.820546 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:02.820549 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:02.820958 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:02.821121 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:02.822248 (+ 1127us) server_negotiation.cc:299] Negotiation successful
0812 00:24:02.822546 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11560,"thread_start_us":11353,"threads_started":1}
I20260812 00:24:02.824420 1871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:02.769695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:45245 (local address 127.18.163.195:57551)
0812 00:24:02.778503 (+ 8808us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:02.778590 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:02.786303 (+ 7713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:02.795391 (+ 9088us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:02.795408 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:02.796208 (+ 800us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:02.797150 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:02.797183 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.801123 (+ 3940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.801129 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:02.803502 (+ 2373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:02.803529 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.809311 (+ 5782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.809334 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:02.809783 (+ 449us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:02.810680 (+ 897us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:02.810713 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:02.813555 (+ 2842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:02.818587 (+ 5032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:02.818664 (+ 77us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:02.818687 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:02.819428 (+ 741us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:02.819967 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:02.819973 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:02.819977 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:02.820364 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:02.821140 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:02.821149 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:02.821734 (+ 585us) client_negotiation.cc:769] Sending connection context
0812 00:24:02.822104 (+ 370us) client_negotiation.cc:240] Negotiation successful
0812 00:24:02.822763 (+ 659us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8320,"thread_start_us":8009,"threads_started":1}
I20260812 00:24:02.826510 1869 heartbeater.cc:347] Connected to a master server at 127.18.163.254:45245
I20260812 00:24:02.826931 1869 heartbeater.cc:464] Registering TS with master...
I20260812 00:24:02.828035 1869 heartbeater.cc:511] Master 127.18.163.254:45245 requested a full tablet report, sending...
I20260812 00:24:02.830114 1333 ts_manager.cc:194] Registered new tserver with Master: dfcc980944ec44dcb72fdde9dcca5be8 (127.18.163.195:39751)
I20260812 00:24:02.831374 1333 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:57551
I20260812 00:24:02.831423 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:24:02.860780 1873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:02.840028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54424 (local address 127.18.163.254:45245)
0812 00:24:02.840241 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:02.840247 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:02.841055 (+ 808us) server_negotiation.cc:407] Connection header received
0812 00:24:02.841260 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:02.841267 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:02.841379 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:02.841508 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:02.843691 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.844783 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.847004 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.847874 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.848004 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:02.852535 (+ 4531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:02.852545 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:02.852549 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:02.852608 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:02.856536 (+ 3928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:02.857826 (+ 1290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:02.857833 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:02.857837 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:02.858051 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:02.858696 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:02.858702 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:02.858706 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:02.859138 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:02.859415 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:02.860106 (+ 691us) server_negotiation.cc:299] Negotiation successful
0812 00:24:02.860421 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 00:24:02.869247 1333 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54424:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:24:02.881608 1333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 12 00:24:02 dist-test-slave-njxd krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494242, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for HTTP/127.18.163.212@KRBTEST.COM
I20260812 00:24:02.988744 1888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:02.922004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:40097 (local address 127.0.0.1:53878)
0812 00:24:02.968660 (+ 46656us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:02.968721 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:02.968960 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:02.977960 (+ 9000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:02.977970 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:02.978024 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:02.978540 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:02.978555 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.981038 (+ 2483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.981045 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:02.983784 (+ 2739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:02.983807 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.987146 (+ 3339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.987166 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:02.987513 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:02.987591 (+ 78us) client_negotiation.cc:769] Sending connection context
0812 00:24:02.987765 (+ 174us) client_negotiation.cc:240] Negotiation successful
0812 00:24:02.988077 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46286,"thread_start_us":58845,"threads_started":1}
I20260812 00:24:02.990023 1891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:02.922724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53878 (local address 127.18.163.193:40097)
0812 00:24:02.957461 (+ 34737us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:02.957471 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:02.969225 (+ 11754us) server_negotiation.cc:407] Connection header received
0812 00:24:02.969342 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:02.969350 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:02.969662 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:02.969861 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:02.978865 (+ 9004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.980548 (+ 1683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.984074 (+ 3526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.986347 (+ 2273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.986644 (+ 297us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:02.986902 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:02.989327 (+ 2425us) server_negotiation.cc:299] Negotiation successful
0812 00:24:02.989611 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34530,"thread_start_us":34331,"threads_started":1}
I20260812 00:24:02.995220 1482 tablet_service.cc:1467] Processing CreateTablet for tablet 7f19daf9001440c19c30d20137063cc6 (DEFAULT_TABLE table=test-table [id=fb696716e7974b3a9a0f207d1e7a8620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:24:02.996996 1482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f19daf9001440c19c30d20137063cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:03.003786 1893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:02.969999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38442 (local address 127.18.163.195:39751)
0812 00:24:02.982169 (+ 12170us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:02.982179 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:02.991247 (+ 9068us) server_negotiation.cc:407] Connection header received
0812 00:24:02.991570 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:02.991579 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:02.991882 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:02.992137 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:02.993234 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.995511 (+ 2277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.999206 (+ 3695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.001472 (+ 2266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.001782 (+ 310us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:03.002053 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:03.002934 (+ 881us) server_negotiation.cc:299] Negotiation successful
0812 00:24:03.003234 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11953,"thread_start_us":11754,"threads_started":1}
I20260812 00:24:03.004801 1888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:02.977766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:39751 (local address 127.0.0.1:38442)
0812 00:24:02.991103 (+ 13337us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:02.991124 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:02.991368 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:02.992661 (+ 1293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:02.992669 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:02.992712 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:02.992963 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:02.992976 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.995806 (+ 2830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.995815 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:02.998834 (+ 3019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:02.998910 (+ 76us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.002322 (+ 3412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.002332 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:03.002633 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:03.002687 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 00:24:03.004095 (+ 1408us) client_negotiation.cc:240] Negotiation successful
0812 00:24:03.004374 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13223,"threads_started":1}
I20260812 00:24:03.021010 1887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:02.922091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:44091 (local address 127.0.0.1:33222)
0812 00:24:02.984230 (+ 62139us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:02.984258 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:02.984509 (+ 251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:02.985557 (+ 1048us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:02.985562 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:02.985619 (+ 57us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:02.986008 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:02.986019 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.987969 (+ 1950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:02.987974 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:02.990225 (+ 2251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:02.990244 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.020004 (+ 29760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.020124 (+ 120us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:03.020329 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:03.020369 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 00:24:03.020467 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 00:24:03.020628 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61993,"thread_start_us":46017,"threads_started":1}
I20260812 00:24:03.021987 1890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:02.922379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33222 (local address 127.18.163.194:44091)
0812 00:24:02.955543 (+ 33164us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:02.955554 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:02.984375 (+ 28821us) server_negotiation.cc:407] Connection header received
0812 00:24:02.984713 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:02.984724 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:02.985030 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:02.985247 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:02.986222 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:02.987782 (+ 1560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.017744 (+ 29962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.019378 (+ 1634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.019615 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:03.019801 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:03.021437 (+ 1636us) server_negotiation.cc:299] Negotiation successful
0812 00:24:03.021665 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32942,"thread_start_us":33165,"threads_started":1}
I20260812 00:24:03.024575 1796 tablet_service.cc:1467] Processing CreateTablet for tablet 7f19daf9001440c19c30d20137063cc6 (DEFAULT_TABLE table=test-table [id=fb696716e7974b3a9a0f207d1e7a8620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:24:03.027064 1796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f19daf9001440c19c30d20137063cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:03.037953 1642 tablet_service.cc:1467] Processing CreateTablet for tablet 7f19daf9001440c19c30d20137063cc6 (DEFAULT_TABLE table=test-table [id=fb696716e7974b3a9a0f207d1e7a8620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:24:03.039803 1642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f19daf9001440c19c30d20137063cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:03.067287 1896 tablet_bootstrap.cc:492] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c: Bootstrap starting.
I20260812 00:24:03.073163 1897 tablet_bootstrap.cc:492] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8: Bootstrap starting.
I20260812 00:24:03.082566 1896 tablet_bootstrap.cc:654] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c: Neither blocks nor log segments found. Creating new log.
I20260812 00:24:03.083410 1897 tablet_bootstrap.cc:654] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8: Neither blocks nor log segments found. Creating new log.
I20260812 00:24:03.084889 1717 heartbeater.cc:503] Master 127.18.163.254:45245 was elected leader, sending a full tablet report...
I20260812 00:24:03.084991 1897 log.cc:824] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:03.101116 1896 log.cc:824] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:03.111975 1897 tablet_bootstrap.cc:492] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8: No bootstrap required, opened a new log
I20260812 00:24:03.112345 1897 ts_tablet_manager.cc:1397] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8: Time spent bootstrapping tablet: real 0.040s user 0.010s sys 0.017s
I20260812 00:24:03.113447 1899 tablet_bootstrap.cc:492] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a: Bootstrap starting.
I20260812 00:24:03.122090 1896 tablet_bootstrap.cc:492] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c: No bootstrap required, opened a new log
I20260812 00:24:03.122462 1896 ts_tablet_manager.cc:1397] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c: Time spent bootstrapping tablet: real 0.056s user 0.010s sys 0.004s
I20260812 00:24:03.124233 1897 raft_consensus.cc:348] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd5e15188db422dbb063f2c01802a6c" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40097 } } peers { permanent_uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44091 } } peers { permanent_uuid: "dfcc980944ec44dcb72fdde9dcca5be8" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39751 } }
I20260812 00:24:03.124760 1897 raft_consensus.cc:374] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:03.124883 1897 raft_consensus.cc:729] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfcc980944ec44dcb72fdde9dcca5be8, State: Initialized, Role: FOLLOWER
I20260812 00:24:03.125741 1897 consensus_queue.cc:260] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd5e15188db422dbb063f2c01802a6c" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40097 } } peers { permanent_uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44091 } } peers { permanent_uuid: "dfcc980944ec44dcb72fdde9dcca5be8" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39751 } }
I20260812 00:24:03.127051 1869 heartbeater.cc:503] Master 127.18.163.254:45245 was elected leader, sending a full tablet report...
I20260812 00:24:03.127825 1897 ts_tablet_manager.cc:1428] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260812 00:24:03.140424 1899 tablet_bootstrap.cc:654] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a: Neither blocks nor log segments found. Creating new log.
I20260812 00:24:03.142112 1899 log.cc:824] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:03.143226 1896 raft_consensus.cc:348] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd5e15188db422dbb063f2c01802a6c" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40097 } } peers { permanent_uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44091 } } peers { permanent_uuid: "dfcc980944ec44dcb72fdde9dcca5be8" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39751 } }
I20260812 00:24:03.143765 1896 raft_consensus.cc:374] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:03.143872 1896 raft_consensus.cc:729] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fd5e15188db422dbb063f2c01802a6c, State: Initialized, Role: FOLLOWER
I20260812 00:24:03.144614 1896 consensus_queue.cc:260] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd5e15188db422dbb063f2c01802a6c" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40097 } } peers { permanent_uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44091 } } peers { permanent_uuid: "dfcc980944ec44dcb72fdde9dcca5be8" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39751 } }
I20260812 00:24:03.152125 1899 tablet_bootstrap.cc:492] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a: No bootstrap required, opened a new log
I20260812 00:24:03.152588 1899 ts_tablet_manager.cc:1397] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.003s
I20260812 00:24:03.154716 1556 heartbeater.cc:503] Master 127.18.163.254:45245 was elected leader, sending a full tablet report...
I20260812 00:24:03.155471 1896 ts_tablet_manager.cc:1428] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c: Time spent starting tablet: real 0.033s user 0.020s sys 0.003s
I20260812 00:24:03.164086 1899 raft_consensus.cc:348] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd5e15188db422dbb063f2c01802a6c" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40097 } } peers { permanent_uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44091 } } peers { permanent_uuid: "dfcc980944ec44dcb72fdde9dcca5be8" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39751 } }
I20260812 00:24:03.164677 1899 raft_consensus.cc:374] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:03.164800 1899 raft_consensus.cc:729] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d6a3327b24b4f43a1a160a3b5b3f88a, State: Initialized, Role: FOLLOWER
I20260812 00:24:03.165665 1899 consensus_queue.cc:260] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd5e15188db422dbb063f2c01802a6c" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40097 } } peers { permanent_uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44091 } } peers { permanent_uuid: "dfcc980944ec44dcb72fdde9dcca5be8" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39751 } }
I20260812 00:24:03.167893 1899 ts_tablet_manager.cc:1428] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a: Time spent starting tablet: real 0.015s user 0.016s sys 0.001s
W20260812 00:24:03.269717 1718 tablet.cc:2369] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:24:03.283649 1870 tablet.cc:2369] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:24:03.375336 1557 tablet.cc:2369] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:24:03.391880 1905 raft_consensus.cc:482] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:24:03.392230 1905 raft_consensus.cc:504] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd5e15188db422dbb063f2c01802a6c" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40097 } } peers { permanent_uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44091 } } peers { permanent_uuid: "dfcc980944ec44dcb72fdde9dcca5be8" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39751 } }
I20260812 00:24:03.394212 1905 leader_election.cc:288] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fd5e15188db422dbb063f2c01802a6c (127.18.163.193:40097), dfcc980944ec44dcb72fdde9dcca5be8 (127.18.163.195:39751)
I20260812 00:24:03.403172 1902 raft_consensus.cc:482] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:24:03.403533 1902 raft_consensus.cc:504] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd5e15188db422dbb063f2c01802a6c" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40097 } } peers { permanent_uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44091 } } peers { permanent_uuid: "dfcc980944ec44dcb72fdde9dcca5be8" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39751 } }
I20260812 00:24:03.404726 1891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:03.395118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:47747 (local address 127.18.163.193:40097)
0812 00:24:03.395330 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:03.395336 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:03.395823 (+ 487us) server_negotiation.cc:407] Connection header received
0812 00:24:03.396199 (+ 376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:03.396205 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:03.396314 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:03.396418 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:03.397202 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.398099 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.401306 (+ 3207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.402687 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.402874 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:03.402957 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:03.404266 (+ 1309us) server_negotiation.cc:299] Negotiation successful
0812 00:24:03.404430 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 00:24:03.405547 1893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:03.394730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:41263 (local address 127.18.163.195:39751)
0812 00:24:03.394961 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:03.394969 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:03.396212 (+ 1243us) server_negotiation.cc:407] Connection header received
0812 00:24:03.396389 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:03.396397 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:03.396502 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:03.396590 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:03.397289 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.398444 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.403067 (+ 4623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.404374 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.404543 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:03.404642 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:03.405127 (+ 485us) server_negotiation.cc:299] Negotiation successful
0812 00:24:03.405275 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 00:24:03.405771 1915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:03.394526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:40097 (local address 127.18.163.194:47747)
0812 00:24:03.395653 (+ 1127us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:03.395679 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:03.395988 (+ 309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:03.396458 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:03.396462 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:03.396488 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:03.397007 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:03.397021 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.398318 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.398327 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:03.401057 (+ 2730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:03.401077 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.403295 (+ 2218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.403303 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:03.403556 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:03.403592 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:24:03.405128 (+ 1536us) client_negotiation.cc:240] Negotiation successful
0812 00:24:03.405288 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":906,"mutex_wait_us":133,"thread_start_us":827,"threads_started":1}
I20260812 00:24:03.406653 1916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:03.394734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:39751 (local address 127.18.163.194:41263)
0812 00:24:03.396078 (+ 1344us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:03.396097 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:03.396244 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:03.396651 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:03.396659 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:03.396690 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:03.397075 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:03.397085 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.398606 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.398611 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:03.401057 (+ 2446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:03.401077 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.404601 (+ 3524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.404608 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:03.404898 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:03.404937 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 00:24:03.406086 (+ 1149us) client_negotiation.cc:240] Negotiation successful
0812 00:24:03.406267 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1218,"mutex_wait_us":103,"thread_start_us":1051,"threads_started":1}
I20260812 00:24:03.406955 1505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f19daf9001440c19c30d20137063cc6" candidate_uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fd5e15188db422dbb063f2c01802a6c" is_pre_election: true
I20260812 00:24:03.407677 1505 raft_consensus.cc:2454] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d6a3327b24b4f43a1a160a3b5b3f88a in term 0.
I20260812 00:24:03.405684 1902 leader_election.cc:288] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fd5e15188db422dbb063f2c01802a6c (127.18.163.193:40097), 5d6a3327b24b4f43a1a160a3b5b3f88a (127.18.163.194:44091)
I20260812 00:24:03.408541 1587 leader_election.cc:302] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d6a3327b24b4f43a1a160a3b5b3f88a, 8fd5e15188db422dbb063f2c01802a6c; no voters:
I20260812 00:24:03.409087 1905 raft_consensus.cc:2781] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:24:03.409256 1905 raft_consensus.cc:482] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:24:03.409359 1905 raft_consensus.cc:3037] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:03.413164 1905 raft_consensus.cc:504] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd5e15188db422dbb063f2c01802a6c" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40097 } } peers { permanent_uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44091 } } peers { permanent_uuid: "dfcc980944ec44dcb72fdde9dcca5be8" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39751 } }
I20260812 00:24:03.414909 1505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f19daf9001440c19c30d20137063cc6" candidate_uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fd5e15188db422dbb063f2c01802a6c"
I20260812 00:24:03.415201 1505 raft_consensus.cc:3037] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:03.416863 1891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:03.407230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:49975 (local address 127.18.163.193:40097)
0812 00:24:03.407444 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:03.407451 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:03.408748 (+ 1297us) server_negotiation.cc:407] Connection header received
0812 00:24:03.409085 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:03.409091 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:03.409178 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:03.409254 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:03.410189 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.411346 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.414138 (+ 2792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.415455 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.415663 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:03.415767 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:03.416378 (+ 611us) server_negotiation.cc:299] Negotiation successful
0812 00:24:03.416549 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 00:24:03.417675 1919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:03.406105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:40097 (local address 127.18.163.195:49975)
0812 00:24:03.408634 (+ 2529us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:03.408657 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:03.408896 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:03.409503 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:03.409509 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:03.409540 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:03.409980 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:03.409996 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.411565 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.411570 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:03.413899 (+ 2329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:03.413920 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.415967 (+ 2047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.415973 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:03.416170 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:03.416207 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 00:24:03.417070 (+ 863us) client_negotiation.cc:240] Negotiation successful
0812 00:24:03.417249 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2367,"threads_started":1}
I20260812 00:24:03.418998 1905 leader_election.cc:288] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [CANDIDATE]: Term 1 election: Requested vote from peers 8fd5e15188db422dbb063f2c01802a6c (127.18.163.193:40097), dfcc980944ec44dcb72fdde9dcca5be8 (127.18.163.195:39751)
I20260812 00:24:03.418875 1504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f19daf9001440c19c30d20137063cc6" candidate_uuid: "dfcc980944ec44dcb72fdde9dcca5be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fd5e15188db422dbb063f2c01802a6c" is_pre_election: true
I20260812 00:24:03.419524 1818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f19daf9001440c19c30d20137063cc6" candidate_uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfcc980944ec44dcb72fdde9dcca5be8"
I20260812 00:24:03.419485 1819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f19daf9001440c19c30d20137063cc6" candidate_uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfcc980944ec44dcb72fdde9dcca5be8" is_pre_election: true
I20260812 00:24:03.420071 1818 raft_consensus.cc:3037] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:03.420549 1505 raft_consensus.cc:2454] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d6a3327b24b4f43a1a160a3b5b3f88a in term 1.
I20260812 00:24:03.422511 1587 leader_election.cc:302] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d6a3327b24b4f43a1a160a3b5b3f88a, 8fd5e15188db422dbb063f2c01802a6c; no voters:
I20260812 00:24:03.422866 1905 raft_consensus.cc:2781] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:24:03.423925 1818 raft_consensus.cc:2454] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d6a3327b24b4f43a1a160a3b5b3f88a in term 1.
I20260812 00:24:03.424971 1905 raft_consensus.cc:686] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [term 1 LEADER]: Becoming Leader. State: Replica: 5d6a3327b24b4f43a1a160a3b5b3f88a, State: Running, Role: LEADER
I20260812 00:24:03.426272 1905 consensus_queue.cc:237] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd5e15188db422dbb063f2c01802a6c" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40097 } } peers { permanent_uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44091 } } peers { permanent_uuid: "dfcc980944ec44dcb72fdde9dcca5be8" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39751 } }
I20260812 00:24:03.427121 1890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:03.407423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:52559 (local address 127.18.163.194:44091)
0812 00:24:03.407597 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:03.407603 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:03.419370 (+ 11767us) server_negotiation.cc:407] Connection header received
0812 00:24:03.419696 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:03.419704 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:03.419783 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:03.419843 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:03.421194 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.422394 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.424949 (+ 2555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.426044 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.426248 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:03.426334 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:03.426686 (+ 352us) server_negotiation.cc:299] Negotiation successful
0812 00:24:03.426825 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 00:24:03.427310 1917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:03.406600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:44091 (local address 127.18.163.195:52559)
0812 00:24:03.419260 (+ 12660us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:03.419279 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:03.419493 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:03.420547 (+ 1054us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:03.420551 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:03.420581 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:03.421003 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:03.421017 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.422586 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.422593 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:03.424723 (+ 2130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:03.424743 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.426283 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.426290 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:03.426472 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:03.426500 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 00:24:03.426641 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 00:24:03.426794 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11250,"thread_start_us":1729,"threads_started":1}
I20260812 00:24:03.428294 1664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f19daf9001440c19c30d20137063cc6" candidate_uuid: "dfcc980944ec44dcb72fdde9dcca5be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a" is_pre_election: true
I20260812 00:24:03.429364 1743 leader_election.cc:302] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfcc980944ec44dcb72fdde9dcca5be8; no voters: 5d6a3327b24b4f43a1a160a3b5b3f88a, 8fd5e15188db422dbb063f2c01802a6c
I20260812 00:24:03.429847 1902 raft_consensus.cc:2726] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 00:24:03.438498 1333 catalog_manager.cc:5495] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d6a3327b24b4f43a1a160a3b5b3f88a (127.18.163.194). New cstate: current_term: 1 leader_uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd5e15188db422dbb063f2c01802a6c" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d6a3327b24b4f43a1a160a3b5b3f88a" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dfcc980944ec44dcb72fdde9dcca5be8" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260812 00:24:03.508723 1890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:03.501979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33236 (local address 127.18.163.194:44091)
0812 00:24:03.502195 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:03.502203 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:03.502705 (+ 502us) server_negotiation.cc:407] Connection header received
0812 00:24:03.502989 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:03.502993 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:03.503095 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:03.503271 (+ 176us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:24:03.503749 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.504530 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.506232 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.506667 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.506815 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:03.507412 (+ 597us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:24:03.507995 (+ 583us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:24:03.508193 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:03.508300 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 00:24:03.508399 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 00:24:03.518018 1505 raft_consensus.cc:1261] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c [term 1 FOLLOWER]: Refusing update from remote peer 5d6a3327b24b4f43a1a160a3b5b3f88a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:24:03.518025 1818 raft_consensus.cc:1261] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8 [term 1 FOLLOWER]: Refusing update from remote peer 5d6a3327b24b4f43a1a160a3b5b3f88a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:24:03.519008 1920 consensus_queue.cc:1035] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fd5e15188db422dbb063f2c01802a6c" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 40097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:24:03.519516 1905 consensus_queue.cc:1035] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfcc980944ec44dcb72fdde9dcca5be8" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:24:03.542913 1928 mvcc.cc:205] Tried to move back new op lower bound from 7317480421438509056 to 7317480421082161152. Current Snapshot: MvccSnapshot[applied={T|T < 7317480421438509056 or (T in {7317480421438509056})}]
I20260812 00:24:03.546841 1931 mvcc.cc:205] Tried to move back new op lower bound from 7317480421438509056 to 7317480421082161152. Current Snapshot: MvccSnapshot[applied={T|T < 7317480421438509056}]
I20260812 00:24:03.567458 1333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:24:03.567780 1333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:24:03.572183 1333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a65d6f05aeb48aa9ddca2415e89b946: Sending DeleteTablet for 3 replicas of tablet 7f19daf9001440c19c30d20137063cc6
I20260812 00:24:03.573642 1482 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f19daf9001440c19c30d20137063cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:24:03 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:53878
I20260812 00:24:03.574731 1938 tablet_replica.cc:330] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c: stopping tablet replica
I20260812 00:24:03.575379 1938 raft_consensus.cc:2229] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:24:03.575827 1642 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f19daf9001440c19c30d20137063cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:24:03 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:33222
I20260812 00:24:03.576069 1938 raft_consensus.cc:2258] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:24:03.576752 1796 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f19daf9001440c19c30d20137063cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:24:03 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:38442
I20260812 00:24:03.577800 1940 tablet_replica.cc:330] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8: stopping tablet replica
I20260812 00:24:03.578318 1940 raft_consensus.cc:2229] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:24:03.578855 1940 raft_consensus.cc:2258] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:24:03.580394 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 1376
I20260812 00:24:03.587992 1940 ts_tablet_manager.cc:1905] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:24:03.592955 1938 ts_tablet_manager.cc:1905] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:24:03.605922 1940 ts_tablet_manager.cc:1918] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:24:03.607025 1940 log.cc:1196] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/7f19daf9001440c19c30d20137063cc6
I20260812 00:24:03.607928 1940 ts_tablet_manager.cc:1939] T 7f19daf9001440c19c30d20137063cc6 P dfcc980944ec44dcb72fdde9dcca5be8: Deleting consensus metadata
I20260812 00:24:03.611253 1317 catalog_manager.cc:4841] TS dfcc980944ec44dcb72fdde9dcca5be8 (127.18.163.195:39751): tablet 7f19daf9001440c19c30d20137063cc6 (table test-table [id=fb696716e7974b3a9a0f207d1e7a8620]) successfully deleted
I20260812 00:24:03.612231 1939 tablet_replica.cc:330] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a: stopping tablet replica
I20260812 00:24:03.613001 1939 raft_consensus.cc:2229] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:24:03.614074 1939 raft_consensus.cc:2258] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:24:03.622397 1939 ts_tablet_manager.cc:1905] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:24:03.629866 1939 ts_tablet_manager.cc:1918] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:24:03.630195 1939 log.cc:1196] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/7f19daf9001440c19c30d20137063cc6
I20260812 00:24:03.630838 1939 ts_tablet_manager.cc:1939] T 7f19daf9001440c19c30d20137063cc6 P 5d6a3327b24b4f43a1a160a3b5b3f88a: Deleting consensus metadata
I20260812 00:24:03.632839 1317 catalog_manager.cc:4841] TS 5d6a3327b24b4f43a1a160a3b5b3f88a (127.18.163.194:44091): tablet 7f19daf9001440c19c30d20137063cc6 (table test-table [id=fb696716e7974b3a9a0f207d1e7a8620]) successfully deleted
I20260812 00:24:03.635601 1938 ts_tablet_manager.cc:1918] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:24:03.637830 1938 log.cc:1196] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/7f19daf9001440c19c30d20137063cc6
I20260812 00:24:03.640597 1938 ts_tablet_manager.cc:1939] T 7f19daf9001440c19c30d20137063cc6 P 8fd5e15188db422dbb063f2c01802a6c: Deleting consensus metadata
I20260812 00:24:03.646167 1315 catalog_manager.cc:4841] TS 8fd5e15188db422dbb063f2c01802a6c (127.18.163.193:40097): tablet 7f19daf9001440c19c30d20137063cc6 (table test-table [id=fb696716e7974b3a9a0f207d1e7a8620]) successfully deleted
I20260812 00:24:03.653402 1891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:03.583710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53884 (local address 127.18.163.193:40097)
0812 00:24:03.583983 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:03.583993 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:03.621451 (+ 37458us) server_negotiation.cc:407] Connection header received
0812 00:24:03.625866 (+ 4415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:03.625876 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:03.626012 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:03.626109 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:03.633801 (+ 7692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.635004 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.638086 (+ 3082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.638758 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.638898 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:03.646678 (+ 7780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:03.646693 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:03.646709 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:03.646753 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:03.650180 (+ 3427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:03.651046 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:03.651054 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:03.651056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:03.651211 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:03.651665 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:03.651669 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:03.651671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:03.652045 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:03.652395 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:03.652761 (+ 366us) server_negotiation.cc:299] Negotiation successful
0812 00:24:03.653018 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260812 00:24:03.654203 1549 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:03.751259 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 1376
I20260812 00:24:03.777124 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 1560
I20260812 00:24:03.792925 1890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:03.778036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33244 (local address 127.18.163.194:44091)
0812 00:24:03.778351 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:03.778360 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:03.778383 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:24:03.778605 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:03.778609 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:03.778689 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:03.778803 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:03.780222 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.781002 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.782535 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.782989 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.783139 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:03.786004 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:03.786018 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:03.786034 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:03.786077 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:03.789328 (+ 3251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:03.790201 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:03.790208 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:03.790210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:03.790378 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:03.790825 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:03.790829 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:03.790831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:03.791263 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:03.791614 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:03.792286 (+ 672us) server_negotiation.cc:299] Negotiation successful
0812 00:24:03.792541 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161}
I20260812 00:24:03.793782 1712 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:03.915411 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 1560
I20260812 00:24:03.939405 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 1722
I20260812 00:24:03.954383 1945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:03.940204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38450 (local address 127.18.163.195:39751)
0812 00:24:03.940720 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:03.940725 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:03.940741 (+ 16us) server_negotiation.cc:407] Connection header received
0812 00:24:03.940794 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:03.940798 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:03.940859 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:03.940983 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:03.942448 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.943158 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.944531 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:03.944966 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:03.945103 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:03.947969 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:03.947985 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:03.948002 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:03.948047 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:03.951173 (+ 3126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:03.952007 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:03.952016 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:03.952018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:03.952161 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:03.952589 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:03.952595 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:03.952604 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:03.953025 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:03.953357 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:03.953721 (+ 364us) server_negotiation.cc:299] Negotiation successful
0812 00:24:03.953977 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":248,"threads_started":1}
I20260812 00:24:03.955145 1864 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:04.049618 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 1722
I20260812 00:24:04.073742 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 1296
I20260812 00:24:04.075088 1366 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:04.192690 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 1296
I20260812 00:24:04.226039 19087 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 00:24:04.572650 19087 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 00:24:04.572883 19087 mini_ranger.cc:66] Stopping Ranger...
I20260812 00:24:04.929914 19087 mini_ranger.cc:68] Stopped Ranger
2026-08-12 00:24:04.930 UTC [32708] LOG: received smart shutdown request
2026-08-12 00:24:04.934 UTC [32708] LOG: background worker "logical replication launcher" (PID 32717) exited with exit code 1
2026-08-12 00:24:04.934 UTC [32711] LOG: shutting down
2026-08-12 00:24:05.111 UTC [32708] LOG: database system is shut down
2026-08-12T00:24:05Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (57332 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:24:05 dist-test-slave-njxd krb5kdc[1959](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:24:05 dist-test-slave-njxd krb5kdc[1959](info): set up 2 sockets
Aug 12 00:24:05 dist-test-slave-njxd krb5kdc[1959](info): commencing operation
krb5kdc: starting...
W20260812 00:24:06.485209 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.197s user 0.000s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:24:06 dist-test-slave-njxd krb5kdc[1959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:24:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:24:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:24:06.824925 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:34041
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:39821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:34041,127.18.163.253:39515,127.18.163.252:33213
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:24:07.194590 1976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:07.194929 1976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:07.195129 1976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:07.202639 1976 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:24:07.202776 1976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:07.202893 1976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:07.203007 1976 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:24:07.203100 1976 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:24:07.213688 1976 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:39821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:34041,127.18.163.253:39515,127.18.163.252:33213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:34041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:07.215230 1976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:07.216706 1976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:07.229707 1982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:07.229732 1983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:07.229704 1985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:07.230623 1976 server_base.cc:1034] running on GCE node
I20260812 00:24:07.231463 1976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:07.233090 1976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:07.234314 1976 hybrid_clock.cc:648] HybridClock initialized: now 1786494247234253 us; error 64 us; skew 500 ppm
I20260812 00:24:07.234696 1976 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:07 dist-test-slave-njxd krb5kdc[1959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494247, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:07.243414 1976 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:24:07.245247 1976 webserver.cc:460] Webserver started at http://127.18.163.254:36777/ using document root <none> and password file <none>
I20260812 00:24:07.246140 1976 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:07.246296 1976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:07.246658 1976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:24:07.250231 1976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "63da53274d044e5c82e27b28673a39c3"
format_stamp: "Formatted at 2026-08-12 00:24:07 on dist-test-slave-njxd"
server_key: "b87406aade13ae95009b3b9ac079bf66"
server_key_iv: "76d6f22df2e6c5622a5b7229be0d3260"
server_key_version: "encryptionkey@0"
I20260812 00:24:07.251201 1976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "63da53274d044e5c82e27b28673a39c3"
format_stamp: "Formatted at 2026-08-12 00:24:07 on dist-test-slave-njxd"
server_key: "b87406aade13ae95009b3b9ac079bf66"
server_key_iv: "76d6f22df2e6c5622a5b7229be0d3260"
server_key_version: "encryptionkey@0"
I20260812 00:24:07.258080 1976 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 00:24:07.262264 1994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:07.263944 1976 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:24:07.264189 1976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "63da53274d044e5c82e27b28673a39c3"
format_stamp: "Formatted at 2026-08-12 00:24:07 on dist-test-slave-njxd"
server_key: "b87406aade13ae95009b3b9ac079bf66"
server_key_iv: "76d6f22df2e6c5622a5b7229be0d3260"
server_key_version: "encryptionkey@0"
I20260812 00:24:07.264431 1976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:07.279968 1976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:07.285058 1976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:07.285406 1976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:07.307094 1976 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:34041
I20260812 00:24:07.307126 2054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:34041 every 8 connection(s)
I20260812 00:24:07.308694 1976 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:24:07.309080 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 1976
I20260812 00:24:07.309340 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:24:07.310168 19087 external_mini_cluster.cc:1428] Setting key 925e2c80f43984bf2ab111b0ea53954c
I20260812 00:24:07.313395 2056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:07.320858 2056 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:24:07 dist-test-slave-njxd krb5kdc[1959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494247, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.163.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.253@KRBTEST.COM" created.
I20260812 00:24:07.351343 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.324870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34041 (local address 127.0.0.1:45268)
0812 00:24:07.326540 (+ 1670us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:07.326593 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:07.329830 (+ 3237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:07.331023 (+ 1193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:07.331033 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:07.331981 (+ 948us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:07.332553 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:07.332593 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:07.334515 (+ 1922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:07.334523 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:07.336728 (+ 2205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:07.336754 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:07.338032 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:07.338046 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:07.338296 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:07.339170 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:07.339211 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:07.342453 (+ 3242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:07.346621 (+ 4168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:07.346636 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:07.346650 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:07.347100 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:07.347565 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:07.347570 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:07.347573 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:07.347752 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:07.348953 (+ 1201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:07.348960 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:07.349184 (+ 224us) client_negotiation.cc:769] Sending connection context
0812 00:24:07.349445 (+ 261us) client_negotiation.cc:240] Negotiation successful
0812 00:24:07.350087 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1357,"mutex_wait_us":67,"thread_start_us":1094,"threads_started":1}
I20260812 00:24:07.351416 2061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.324866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45268 (local address 127.18.163.254:34041)
0812 00:24:07.326207 (+ 1341us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:07.326227 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:07.326778 (+ 551us) server_negotiation.cc:407] Connection header received
0812 00:24:07.330384 (+ 3606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:07.330391 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:07.330714 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:07.330906 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:07.332846 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:07.334312 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:07.336960 (+ 2648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:07.337699 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:07.337868 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:07.342761 (+ 4893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:07.342771 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:07.342786 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:07.342823 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:07.346451 (+ 3628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:07.347259 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:07.347275 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:07.347277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:07.347432 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:07.347915 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:07.347919 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:07.347922 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:07.348726 (+ 804us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:07.348985 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:07.349671 (+ 686us) server_negotiation.cc:299] Negotiation successful
0812 00:24:07.350292 (+ 621us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":190,"server-negotiator.queue_time_us":994,"thread_start_us":699,"threads_started":1}
I20260812 00:24:07.354923 2056 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:24:07.356256 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.355680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39515 (local address 127.0.0.1:47184)
0812 00:24:07.355902 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:07.356069 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:39515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260812 00:24:07.356550 1997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.163.253:39515: connect: Connection refused (error 111)
I20260812 00:24:07.358566 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.358022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39515 (local address 127.0.0.1:47194)
0812 00:24:07.358250 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:07.358358 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:39515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 00:24:07.358803 2056 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.253:39515: Network error: Client connection negotiation failed: client connection to 127.18.163.253:39515: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.253.keytab.
Entry for principal kudu/127.18.163.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.253.keytab.
I20260812 00:24:07.388403 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.253:39515
--webserver_interface=127.18.163.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.253.keytab
--principal=kudu/127.18.163.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:39821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:34041,127.18.163.253:39515,127.18.163.252:33213
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:24:07.408341 2056 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } attempt: 1
I20260812 00:24:07.409874 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.409206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39515 (local address 127.0.0.1:47200)
0812 00:24:07.409449 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:07.409692 (+ 243us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:39515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260812 00:24:07.411103 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.410679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39515 (local address 127.0.0.1:47206)
0812 00:24:07.410864 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:07.410942 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:39515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260812 00:24:07.411299 2056 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.253:39515: Network error: Client connection negotiation failed: client connection to 127.18.163.253:39515: connect: Connection refused (error 111)
I20260812 00:24:07.479609 2056 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } attempt: 2
I20260812 00:24:07.480857 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.480343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39515 (local address 127.0.0.1:47210)
0812 00:24:07.480619 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:07.480707 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:39515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260812 00:24:07.482019 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.481654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39515 (local address 127.0.0.1:47224)
0812 00:24:07.481819 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:07.481885 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:39515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 00:24:07.482206 2056 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.253:39515: Network error: Client connection negotiation failed: client connection to 127.18.163.253:39515: connect: Connection refused (error 111)
I20260812 00:24:07.573470 2056 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } attempt: 3
I20260812 00:24:07.574698 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.574210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39515 (local address 127.0.0.1:47230)
0812 00:24:07.574425 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:07.574554 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:39515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260812 00:24:07.575899 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.575488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39515 (local address 127.0.0.1:47234)
0812 00:24:07.575655 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:07.575747 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:39515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260812 00:24:07.576090 2056 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.253:39515: Network error: Client connection negotiation failed: client connection to 127.18.163.253:39515: connect: Connection refused (error 111)
I20260812 00:24:07.719470 2056 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } attempt: 4
I20260812 00:24:07.720834 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.720275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39515 (local address 127.0.0.1:47240)
0812 00:24:07.720594 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:07.720683 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:39515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
I20260812 00:24:07.722105 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.721702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39515 (local address 127.0.0.1:47246)
0812 00:24:07.721866 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:07.721968 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:39515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 00:24:07.722314 2056 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.253:39515: Network error: Client connection negotiation failed: client connection to 127.18.163.253:39515: connect: Connection refused (error 111)
W20260812 00:24:07.762755 2066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:07.763131 2066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:07.763291 2066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:07.771158 2066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:24:07.771332 2066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:07.771436 2066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:07.771541 2066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:24:07.771627 2066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:24:07.782161 2066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:39821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:34041,127.18.163.253:39515,127.18.163.252:33213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.253.keytab
--principal=kudu/127.18.163.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.253:39515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.163.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:07.783685 2066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:07.785100 2066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:07.798066 2075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:07.798149 2073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:07.798063 2072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:07.798980 2066 server_base.cc:1034] running on GCE node
I20260812 00:24:07.799928 2066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:07.801694 2066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:07.802963 2066 hybrid_clock.cc:648] HybridClock initialized: now 1786494247802900 us; error 68 us; skew 500 ppm
I20260812 00:24:07.803365 2066 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:07 dist-test-slave-njxd krb5kdc[1959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494247, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:07.806945 2066 init.cc:377] Logged in from keytab as kudu/127.18.163.253@KRBTEST.COM (short username kudu)
I20260812 00:24:07.808761 2066 webserver.cc:460] Webserver started at http://127.18.163.253:39713/ using document root <none> and password file <none>
I20260812 00:24:07.809665 2066 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:07.809834 2066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:07.810184 2066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:24:07.813560 2066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-1/data/instance:
uuid: "ff16d75b208f4e92a5daff5409aa1782"
format_stamp: "Formatted at 2026-08-12 00:24:07 on dist-test-slave-njxd"
server_key: "afcf088aa963ec8f41593f96e487703a"
server_key_iv: "733ffa77e54479e47439c25a4ea44919"
server_key_version: "encryptionkey@0"
I20260812 00:24:07.814635 2066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-1/wal/instance:
uuid: "ff16d75b208f4e92a5daff5409aa1782"
format_stamp: "Formatted at 2026-08-12 00:24:07 on dist-test-slave-njxd"
server_key: "afcf088aa963ec8f41593f96e487703a"
server_key_iv: "733ffa77e54479e47439c25a4ea44919"
server_key_version: "encryptionkey@0"
I20260812 00:24:07.820607 2066 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260812 00:24:07.824664 2082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:07.826423 2066 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 00:24:07.826653 2066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-1/wal
uuid: "ff16d75b208f4e92a5daff5409aa1782"
format_stamp: "Formatted at 2026-08-12 00:24:07 on dist-test-slave-njxd"
server_key: "afcf088aa963ec8f41593f96e487703a"
server_key_iv: "733ffa77e54479e47439c25a4ea44919"
server_key_version: "encryptionkey@0"
I20260812 00:24:07.826896 2066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:07.842199 2066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:07.846776 2066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:07.847100 2066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:07.869482 2066 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.253:39515
I20260812 00:24:07.869534 2140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.253:39515 every 8 connection(s)
I20260812 00:24:07.871105 2066 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-1/data/info.pb
I20260812 00:24:07.873508 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 2066
I20260812 00:24:07.873766 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-1/wal/instance
I20260812 00:24:07.874362 19087 external_mini_cluster.cc:1428] Setting key 85e522a08349c6a56b7315bccead5a10
I20260812 00:24:07.875869 2141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:07.886941 2141 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:24:07 dist-test-slave-njxd krb5kdc[1959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494247, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.253@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.163.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.252@KRBTEST.COM" created.
I20260812 00:24:07.911039 2144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.890503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45270 (local address 127.18.163.254:34041)
0812 00:24:07.891095 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:07.891100 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:07.892292 (+ 1192us) server_negotiation.cc:407] Connection header received
0812 00:24:07.894504 (+ 2212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:07.894512 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:07.894636 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:07.894770 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:07.896505 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:07.897314 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:07.899128 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:07.899577 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:07.899733 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:07.903804 (+ 4071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:07.903810 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:07.903813 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:07.903855 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:07.907050 (+ 3195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:07.908112 (+ 1062us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:07.908118 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:07.908120 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:07.908283 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:07.908908 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:07.908912 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:07.908915 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:07.909250 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:07.909384 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:07.910535 (+ 1151us) server_negotiation.cc:299] Negotiation successful
0812 00:24:07.910746 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":344,"threads_started":1}
I20260812 00:24:07.912828 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.891222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34041 (local address 127.0.0.1:45270)
0812 00:24:07.892097 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:07.892145 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:07.894169 (+ 2024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:07.895040 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:07.895049 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:07.895637 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:07.896278 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:07.896298 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:07.897515 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:07.897519 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:07.898942 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:07.898959 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:07.899853 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:07.899861 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:07.900116 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:07.900903 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:07.900929 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:07.903488 (+ 2559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:07.907267 (+ 3779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:07.907281 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:07.907329 (+ 48us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:07.907959 (+ 630us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:07.908422 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:07.908427 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:07.908430 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:07.908739 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:07.909406 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:07.909418 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:07.910052 (+ 634us) client_negotiation.cc:769] Sending connection context
0812 00:24:07.910427 (+ 375us) client_negotiation.cc:240] Negotiation successful
0812 00:24:07.911072 (+ 645us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":390,"threads_started":1}
I20260812 00:24:07.915107 2141 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:24:07 dist-test-slave-njxd krb5kdc[1959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494247, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.253@KRBTEST.COM for kudu/127.18.163.253@KRBTEST.COM
I20260812 00:24:07.931517 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.915978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39515 (local address 127.0.0.1:47252)
0812 00:24:07.916227 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:07.916243 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:07.916356 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:07.917507 (+ 1151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:07.917512 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:07.918054 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:07.918222 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:07.918231 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:07.919677 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:07.919684 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:07.920550 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:07.920562 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:07.921477 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:07.921482 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:07.921750 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:07.922416 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:07.922435 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:07.924907 (+ 2472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:07.928672 (+ 3765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:07.928678 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:07.928683 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:07.929104 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:07.929523 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:07.929531 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:07.929535 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:07.929783 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:07.930486 (+ 703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:07.930491 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:07.930643 (+ 152us) client_negotiation.cc:769] Sending connection context
0812 00:24:07.930794 (+ 151us) client_negotiation.cc:240] Negotiation successful
0812 00:24:07.931180 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 00:24:07.932026 2146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.916318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47252 (local address 127.18.163.253:39515)
0812 00:24:07.917032 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:07.917038 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:07.917067 (+ 29us) server_negotiation.cc:407] Connection header received
0812 00:24:07.917124 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:07.917130 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:07.917335 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:07.917523 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:07.918408 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:07.919509 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:07.920712 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:07.921305 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:07.921451 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:07.925176 (+ 3725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:07.925193 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:07.925210 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:07.925244 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:07.928476 (+ 3232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:07.929270 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:07.929278 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:07.929280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:07.929404 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:07.929899 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:07.929907 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:07.929912 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:07.930355 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:07.930596 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:07.930974 (+ 378us) server_negotiation.cc:299] Negotiation successful
0812 00:24:07.931407 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":90,"server-negotiator.queue_time_us":557,"thread_start_us":416,"threads_started":1}
I20260812 00:24:07.934512 2141 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:24:07.935892 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.935405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56254)
0812 00:24:07.935594 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:07.935725 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260812 00:24:07.936204 2086 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
I20260812 00:24:07.938006 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.937647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56270)
0812 00:24:07.937802 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:07.937891 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260812 00:24:07.938262 2141 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:33213: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.252.keytab.
Entry for principal kudu/127.18.163.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.252.keytab.
I20260812 00:24:07.948494 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.252:33213
--webserver_interface=127.18.163.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.252.keytab
--principal=kudu/127.18.163.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:39821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:34041,127.18.163.253:39515,127.18.163.252:33213
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:24:07.987586 2141 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } attempt: 1
I20260812 00:24:07.989058 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.988425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56274)
0812 00:24:07.988689 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:07.988849 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260812 00:24:07.990311 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:07.989870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56288)
0812 00:24:07.990061 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:07.990157 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 00:24:07.990564 2141 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:33213: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
I20260812 00:24:08.021705 2056 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } attempt: 5
Aug 12 00:24:08 dist-test-slave-njxd krb5kdc[1959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494247, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for kudu/127.18.163.253@KRBTEST.COM
I20260812 00:24:08.037657 2146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.022659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47268 (local address 127.18.163.253:39515)
0812 00:24:08.022831 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:08.022839 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:08.022864 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:24:08.023118 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:08.023123 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:08.023213 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:08.023330 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:08.024212 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.025020 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.026886 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.027374 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.027497 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.031726 (+ 4229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:08.031733 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:08.031736 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:08.031777 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:08.034746 (+ 2969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.035638 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.035642 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.035645 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.035778 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.036210 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.036214 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.036216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.036518 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:08.036655 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:08.037152 (+ 497us) server_negotiation.cc:299] Negotiation successful
0812 00:24:08.037339 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 00:24:08.037781 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.022520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39515 (local address 127.0.0.1:47268)
0812 00:24:08.022769 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.022793 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:08.022944 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:08.023371 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:08.023376 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:08.023814 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:08.024017 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:08.024027 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.025203 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.025210 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:08.026680 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:08.026701 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.027574 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.027580 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:08.027795 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.028501 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:08.028527 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:08.031438 (+ 2911us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:08.034925 (+ 3487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:08.034931 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:08.034935 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:08.035494 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:08.035899 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:08.035904 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:08.035908 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:08.036083 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:08.036658 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:08.036665 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:08.036850 (+ 185us) client_negotiation.cc:769] Sending connection context
0812 00:24:08.037027 (+ 177us) client_negotiation.cc:240] Negotiation successful
0812 00:24:08.037404 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260812 00:24:08.039143 2056 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:24:08.040293 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.039890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56304)
0812 00:24:08.040070 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.040154 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260812 00:24:08.041306 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.040956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56320)
0812 00:24:08.041116 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.041196 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260812 00:24:08.041515 2056 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:33213: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
I20260812 00:24:08.058825 2141 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } attempt: 2
I20260812 00:24:08.060225 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.059588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56336)
0812 00:24:08.059871 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.060009 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260812 00:24:08.061390 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.060957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56352)
0812 00:24:08.061125 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.061220 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 00:24:08.061762 2141 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:33213: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
I20260812 00:24:08.092824 2056 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } attempt: 1
I20260812 00:24:08.094146 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.093628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56368)
0812 00:24:08.093848 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.093960 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260812 00:24:08.095438 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.095044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56374)
0812 00:24:08.095221 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.095305 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260812 00:24:08.095757 2056 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:33213: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
I20260812 00:24:08.153053 2141 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } attempt: 3
I20260812 00:24:08.154482 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.153957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56382)
0812 00:24:08.154199 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.154301 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260812 00:24:08.155826 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.155346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56396)
0812 00:24:08.155612 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.155696 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164}
W20260812 00:24:08.156098 2141 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:33213: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
I20260812 00:24:08.164013 2056 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } attempt: 2
I20260812 00:24:08.165290 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.164757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56408)
0812 00:24:08.165016 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.165108 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260812 00:24:08.166410 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.166026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56410)
0812 00:24:08.166201 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.166283 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260812 00:24:08.166697 2056 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:33213: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
I20260812 00:24:08.272948 2056 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } attempt: 3
I20260812 00:24:08.274241 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.273756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56414)
0812 00:24:08.273965 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.274059 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260812 00:24:08.275544 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.275150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56422)
0812 00:24:08.275340 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.275426 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260812 00:24:08.275830 2056 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:33213: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
I20260812 00:24:08.299340 2141 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } attempt: 4
I20260812 00:24:08.300693 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.300158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56438)
0812 00:24:08.300401 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.300496 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260812 00:24:08.301807 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.301409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56452)
0812 00:24:08.301602 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.301689 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 00:24:08.302013 2141 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:33213: Network error: Client connection negotiation failed: client connection to 127.18.163.252:33213: connect: Connection refused (error 111)
W20260812 00:24:08.336692 2149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:08.337095 2149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:08.337265 2149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:08.345075 2149 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:24:08.345258 2149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:08.345376 2149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:08.345484 2149 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:24:08.345564 2149 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:24:08.356148 2149 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:39821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:34041,127.18.163.253:39515,127.18.163.252:33213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.252.keytab
--principal=kudu/127.18.163.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.252:33213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.163.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:08.357693 2149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:08.359117 2149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:08.372138 2155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:08.372184 2156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:08.372102 2158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:08.373411 2149 server_base.cc:1034] running on GCE node
I20260812 00:24:08.374404 2149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:08.375906 2149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:08.377149 2149 hybrid_clock.cc:648] HybridClock initialized: now 1786494248377071 us; error 69 us; skew 500 ppm
I20260812 00:24:08.377558 2149 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:08 dist-test-slave-njxd krb5kdc[1959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494248, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:08.380894 2149 init.cc:377] Logged in from keytab as kudu/127.18.163.252@KRBTEST.COM (short username kudu)
I20260812 00:24:08.382627 2149 webserver.cc:460] Webserver started at http://127.18.163.252:35613/ using document root <none> and password file <none>
I20260812 00:24:08.383416 2149 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:08.383574 2149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:08.383905 2149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:24:08.387157 2149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-2/data/instance:
uuid: "f3859b6266e742a195bf0cae78d434da"
format_stamp: "Formatted at 2026-08-12 00:24:08 on dist-test-slave-njxd"
server_key: "38a8f3729029b3471db6d8a66c99542f"
server_key_iv: "049547f27ce6c708bfa008309f793836"
server_key_version: "encryptionkey@0"
I20260812 00:24:08.387998 2149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-2/wal/instance:
uuid: "f3859b6266e742a195bf0cae78d434da"
format_stamp: "Formatted at 2026-08-12 00:24:08 on dist-test-slave-njxd"
server_key: "38a8f3729029b3471db6d8a66c99542f"
server_key_iv: "049547f27ce6c708bfa008309f793836"
server_key_version: "encryptionkey@0"
I20260812 00:24:08.393745 2149 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 00:24:08.397241 2166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:08.398715 2149 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:24:08.398910 2149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-2/wal
uuid: "f3859b6266e742a195bf0cae78d434da"
format_stamp: "Formatted at 2026-08-12 00:24:08 on dist-test-slave-njxd"
server_key: "38a8f3729029b3471db6d8a66c99542f"
server_key_iv: "049547f27ce6c708bfa008309f793836"
server_key_version: "encryptionkey@0"
I20260812 00:24:08.399124 2149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:08.413448 2149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:08.417773 2149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:08.418084 2149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:08.437877 2149 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.252:33213
I20260812 00:24:08.437922 2223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.252:33213 every 8 connection(s)
I20260812 00:24:08.439357 2149 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-2/data/info.pb
I20260812 00:24:08.443054 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 2149
I20260812 00:24:08.443291 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494024564100-19087-0/minicluster-data/master-2/wal/instance
I20260812 00:24:08.443910 19087 external_mini_cluster.cc:1428] Setting key 1282d958ba03996d379cf28c46b37e05
I20260812 00:24:08.443921 2224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:08.453091 2056 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } attempt: 4
I20260812 00:24:08.455531 2224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:24:08 dist-test-slave-njxd krb5kdc[1959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.252@KRBTEST.COM
Aug 12 00:24:08 dist-test-slave-njxd krb5kdc[1959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494247, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for kudu/127.18.163.252@KRBTEST.COM
I20260812 00:24:08.473384 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.453853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56482)
0812 00:24:08.454102 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.454124 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:08.454243 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:08.456188 (+ 1945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:08.456196 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:08.456748 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:08.456954 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:08.456973 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.458728 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.458734 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:08.460322 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:08.460343 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.461469 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.461477 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:08.461769 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.462562 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:08.462597 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:08.465246 (+ 2649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:08.469287 (+ 4041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:08.469294 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:08.469298 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:08.470002 (+ 704us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:08.470435 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:08.470440 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:08.470444 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:08.470694 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:08.472305 (+ 1611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:08.472310 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:08.472504 (+ 194us) client_negotiation.cc:769] Sending connection context
0812 00:24:08.472661 (+ 157us) client_negotiation.cc:240] Negotiation successful
0812 00:24:08.472985 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"spinlock_wait_cycles":26496}
Aug 12 00:24:08 dist-test-slave-njxd krb5kdc[1959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494248, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.252@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:24:08.473718 2228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.446114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56466 (local address 127.18.163.252:33213)
0812 00:24:08.447022 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:08.447035 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:08.447086 (+ 51us) server_negotiation.cc:407] Connection header received
0812 00:24:08.449135 (+ 2049us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:08.449162 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:08.449729 (+ 567us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:08.450103 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:08.452182 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.453636 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.455272 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.456523 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.456734 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.463155 (+ 6421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:08.463170 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:08.463196 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:08.463258 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:08.467950 (+ 4692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.469030 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.469039 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.469050 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.469300 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.469804 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.469809 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.469812 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.470690 (+ 878us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:08.470992 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:08.471473 (+ 481us) server_negotiation.cc:299] Negotiation successful
0812 00:24:08.472016 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":677,"thread_start_us":433,"threads_started":1}
I20260812 00:24:08.473750 2229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.453975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56482 (local address 127.18.163.252:33213)
0812 00:24:08.455800 (+ 1825us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:08.455806 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:08.455829 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:24:08.455881 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:08.455886 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:08.455968 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:08.456099 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:08.457158 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.458495 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.460541 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.461269 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.462117 (+ 848us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.465535 (+ 3418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:08.465546 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:08.465551 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:08.465623 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:08.469018 (+ 3395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.470152 (+ 1134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.470159 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.470163 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.470307 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.471837 (+ 1530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.471845 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.471849 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.472154 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:08.472325 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:08.472764 (+ 439us) server_negotiation.cc:299] Negotiation successful
0812 00:24:08.472981 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":1654,"thread_start_us":1464,"threads_started":1}
I20260812 00:24:08.481392 2056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3: Bootstrap starting.
I20260812 00:24:08.483445 2231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.458795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34041 (local address 127.0.0.1:45284)
0812 00:24:08.463281 (+ 4486us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.463337 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:08.463518 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:08.464326 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:08.464334 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:08.465426 (+ 1092us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:08.465973 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:08.465986 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.467488 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.467499 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:08.469446 (+ 1947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:08.469467 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.470754 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.470763 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:08.470948 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.471611 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:08.471633 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:08.474677 (+ 3044us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:08.479789 (+ 5112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:08.479804 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:08.479815 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:08.480422 (+ 607us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:08.480973 (+ 551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:08.480982 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:08.480985 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:08.481162 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:08.482142 (+ 980us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:08.482150 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:08.482359 (+ 209us) client_negotiation.cc:769] Sending connection context
0812 00:24:08.482557 (+ 198us) client_negotiation.cc:240] Negotiation successful
0812 00:24:08.482955 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4200,"thread_start_us":4046,"threads_started":1}
I20260812 00:24:08.483750 2230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.458806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45284 (local address 127.18.163.254:34041)
0812 00:24:08.462870 (+ 4064us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:08.462876 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:08.463653 (+ 777us) server_negotiation.cc:407] Connection header received
0812 00:24:08.463714 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:08.463719 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:08.463806 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:08.463938 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:08.466152 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.467250 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.469645 (+ 2395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.470348 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.470478 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.474902 (+ 4424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:08.474909 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:08.474914 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:08.474955 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:08.479598 (+ 4643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.480578 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.480587 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.480593 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.480819 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.481303 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.481311 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.481317 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.481966 (+ 649us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:08.482183 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:08.482734 (+ 551us) server_negotiation.cc:299] Negotiation successful
0812 00:24:08.483059 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3887,"thread_start_us":3710,"threads_started":1}
I20260812 00:24:08.485713 2224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:24:08.485975 2056 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3: Neither blocks nor log segments found. Creating new log.
I20260812 00:24:08.487910 2056 log.cc:824] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3: Log is configured to *not* fsync() on all Append() calls
Aug 12 00:24:08 dist-test-slave-njxd krb5kdc[1959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494248, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.252@KRBTEST.COM for kudu/127.18.163.253@KRBTEST.COM
Aug 12 00:24:08 dist-test-slave-njxd krb5kdc[1959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:24:08.498144 2056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3: No bootstrap required, opened a new log
I20260812 00:24:08.504395 2146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.486994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47272 (local address 127.18.163.253:39515)
0812 00:24:08.487190 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:08.487196 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:08.487215 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:24:08.487364 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:08.487369 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:08.487452 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:08.487534 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:08.488846 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.490289 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.492769 (+ 2480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.493726 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.493856 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.498013 (+ 4157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:08.498020 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:08.498023 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:08.498062 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:08.501413 (+ 3351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.502235 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.502241 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.502245 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.502400 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.502808 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.502832 (+ 24us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.502835 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.503158 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:08.503330 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:08.503752 (+ 422us) server_negotiation.cc:299] Negotiation successful
0812 00:24:08.503982 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 00:24:08.504487 2231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.486611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:39515 (local address 127.0.0.1:47272)
0812 00:24:08.487083 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.487105 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:08.487212 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:08.487794 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:08.487798 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:08.488357 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:08.488586 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:08.488604 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.490561 (+ 1957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.490569 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:08.492534 (+ 1965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:08.492552 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.494206 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.494216 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:08.494581 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.495273 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:08.495303 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:08.497736 (+ 2433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:08.501681 (+ 3945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:08.501686 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:08.501689 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:08.502090 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:08.502524 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:08.502531 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:08.502539 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:08.502690 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:08.503282 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:08.503287 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:08.503447 (+ 160us) client_negotiation.cc:769] Sending connection context
0812 00:24:08.503651 (+ 204us) client_negotiation.cc:240] Negotiation successful
0812 00:24:08.504126 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279}
I20260812 00:24:08.506001 2224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:24:08.507264 2230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.477814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45300 (local address 127.18.163.254:34041)
0812 00:24:08.484766 (+ 6952us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:08.484775 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:08.484797 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:24:08.485001 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:08.485008 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:08.485153 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:08.488635 (+ 3482us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:08.488833 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.490335 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.492908 (+ 2573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.493464 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.493652 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.499142 (+ 5490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:08.499148 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:08.499153 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:08.499195 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:08.503286 (+ 4091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.504625 (+ 1339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.504632 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.504637 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.504803 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.505328 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.505334 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.505337 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.505832 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:08.506138 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:08.506580 (+ 442us) server_negotiation.cc:299] Negotiation successful
0812 00:24:08.506873 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6790,"thread_start_us":15217,"threads_started":1}
I20260812 00:24:08.510815 2056 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } }
I20260812 00:24:08.511327 2056 raft_consensus.cc:374] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:08.511463 2056 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63da53274d044e5c82e27b28673a39c3, State: Initialized, Role: FOLLOWER
I20260812 00:24:08.512215 2056 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } }
Aug 12 00:24:08 dist-test-slave-njxd krb5kdc[1959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494248, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.252@KRBTEST.COM for kudu/127.18.163.252@KRBTEST.COM
I20260812 00:24:08.515530 2234 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } } }
I20260812 00:24:08.516023 2234 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:24:08.516980 2056 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3 [sys.catalog]: configured and running, proceeding with master startup.
Aug 12 00:24:08 dist-test-slave-njxd krb5kdc[1959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.253@KRBTEST.COM
I20260812 00:24:08.523790 2228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.507296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56486 (local address 127.18.163.252:33213)
0812 00:24:08.507497 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:08.507503 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:08.507811 (+ 308us) server_negotiation.cc:407] Connection header received
0812 00:24:08.507963 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:08.507968 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:08.508037 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:08.508141 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:08.508996 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.510074 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.511234 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.511903 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.512036 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.516340 (+ 4304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:08.516346 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:08.516350 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:08.516391 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:08.520222 (+ 3831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.521231 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.521238 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.521241 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.521422 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.521972 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.521976 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.521979 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.522481 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:08.522626 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:08.523165 (+ 539us) server_negotiation.cc:299] Negotiation successful
0812 00:24:08.523435 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 00:24:08.524677 2231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.506902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56486)
0812 00:24:08.507710 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.507729 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:08.507856 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:08.508167 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:08.508172 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:08.508678 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:08.508860 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:08.508869 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.510205 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.510212 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:08.511083 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:08.511094 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.512077 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.512083 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:08.512300 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.512934 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:08.512969 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:08.516130 (+ 3161us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:08.520407 (+ 4277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:08.520415 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:08.520422 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:08.521060 (+ 638us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:08.521638 (+ 578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:08.521645 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:08.521651 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:08.521849 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:08.522711 (+ 862us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:08.522715 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:08.522900 (+ 185us) client_negotiation.cc:769] Sending connection context
0812 00:24:08.523977 (+ 1077us) client_negotiation.cc:240] Negotiation successful
0812 00:24:08.524326 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690}
W20260812 00:24:08.534085 2245 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:24:08.534360 2245 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:24:08.534756 2224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da: Bootstrap starting.
I20260812 00:24:08.527498 1976 master_runner.cc:186] Error getting master registration for 127.18.163.253:39515: OK, instance_id { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" instance_seqno: 1786494247863032 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:24:08.537768 1976 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:24:08.538267 2224 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da: Neither blocks nor log segments found. Creating new log.
W20260812 00:24:08.538596 2001 tablet.cc:2369] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:24:08.539675 2224 log.cc:824] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:08.542225 2146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.509264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47274 (local address 127.18.163.253:39515)
0812 00:24:08.509431 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:08.509437 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:08.509504 (+ 67us) server_negotiation.cc:407] Connection header received
0812 00:24:08.509748 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:08.509754 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:08.509830 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:08.509925 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:08.511745 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.512987 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.514396 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.514854 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.517724 (+ 2870us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.523012 (+ 5288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:08.523020 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:08.523025 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:08.523072 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:08.533983 (+ 10911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.539500 (+ 5517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.539510 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.539516 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.539747 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.540300 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.540306 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.540310 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.540742 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:08.541070 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:08.541520 (+ 450us) server_negotiation.cc:299] Negotiation successful
0812 00:24:08.541844 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 00:24:08.543617 2224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da: No bootstrap required, opened a new log
I20260812 00:24:08.548730 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:24:08.555473 2224 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } }
I20260812 00:24:08.556018 2224 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:08.556174 2224 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3859b6266e742a195bf0cae78d434da, State: Initialized, Role: FOLLOWER
I20260812 00:24:08.556968 2224 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } }
I20260812 00:24:08.564776 2256 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } } }
I20260812 00:24:08.565446 2256 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:24:08.567335 2224 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:24:08.586440 2230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.556535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45314 (local address 127.18.163.254:34041)
0812 00:24:08.556877 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:08.556886 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:08.563727 (+ 6841us) server_negotiation.cc:407] Connection header received
0812 00:24:08.566107 (+ 2380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:08.566129 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:08.566248 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:08.566344 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:08.569172 (+ 2828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.570447 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.573310 (+ 2863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.574131 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.574239 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.578524 (+ 4285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:08.578533 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:08.578538 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:08.578586 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:08.582641 (+ 4055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.583651 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.583659 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.583665 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.583840 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.584374 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.584380 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.584383 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.584810 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:08.585044 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:08.585699 (+ 655us) server_negotiation.cc:299] Negotiation successful
0812 00:24:08.585993 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199}
I20260812 00:24:08.600361 2228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.556083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56494 (local address 127.18.163.252:33213)
0812 00:24:08.556336 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:08.556342 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:08.567516 (+ 11174us) server_negotiation.cc:407] Connection header received
0812 00:24:08.569288 (+ 1772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:08.569295 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:08.569385 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:08.569459 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:08.574968 (+ 5509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.576221 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.580292 (+ 4071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.581187 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.581309 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.591055 (+ 9746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:08.591064 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:08.591069 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:08.591133 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:08.595392 (+ 4259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.597612 (+ 2220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.597618 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.597622 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.597841 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.598353 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.598357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.598360 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.598777 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:08.599026 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:08.599621 (+ 595us) server_negotiation.cc:299] Negotiation successful
0812 00:24:08.599905 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 00:24:08.601289 2146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.568351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47286 (local address 127.18.163.253:39515)
0812 00:24:08.568547 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:08.568555 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:08.574225 (+ 5670us) server_negotiation.cc:407] Connection header received
0812 00:24:08.574513 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:08.574518 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:08.574638 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:08.574719 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:08.581714 (+ 6995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.582853 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.588748 (+ 5895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.589315 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.589405 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.593645 (+ 4240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:08.593653 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:08.593658 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:08.593714 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:08.597477 (+ 3763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.598374 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.598380 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.598383 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.598536 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.599004 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.599009 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.599012 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.599401 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:08.599661 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:08.600226 (+ 565us) server_negotiation.cc:299] Negotiation successful
0812 00:24:08.600887 (+ 661us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 00:24:08.601243 2141 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } attempt: 5
Aug 12 00:24:08 dist-test-slave-njxd krb5kdc[1959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494247, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.253@KRBTEST.COM for kudu/127.18.163.252@KRBTEST.COM
I20260812 00:24:08.622254 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.602877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:33213 (local address 127.0.0.1:56502)
0812 00:24:08.603080 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:08.603103 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:08.603238 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:08.604042 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:08.604050 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:08.604628 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:08.604865 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:08.604877 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.606627 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.606636 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:08.607625 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:08.607644 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.609012 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.609018 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:08.609252 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.610010 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:08.610033 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:08.614386 (+ 4353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:08.619047 (+ 4661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:08.619054 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:08.619058 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:08.619643 (+ 585us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:08.620139 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:08.620145 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:08.620148 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:08.620371 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:08.621139 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:08.621145 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:08.621322 (+ 177us) client_negotiation.cc:769] Sending connection context
0812 00:24:08.621456 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 00:24:08.621827 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 00:24:08.623350 2228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:08.603400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56502 (local address 127.18.163.252:33213)
0812 00:24:08.603650 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:08.603656 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:08.603675 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:24:08.603727 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:08.603732 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:08.603832 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:08.605050 (+ 1218us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:08.605209 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.606433 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.607858 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:08.608795 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:08.609661 (+ 866us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:08.614601 (+ 4940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:08.614611 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:08.614617 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:08.614668 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:08.618871 (+ 4203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.619811 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.619817 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.619825 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.619981 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:08.620537 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:08.620542 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:08.620546 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:08.620969 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:08.622548 (+ 1579us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:08.622690 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 00:24:08.622956 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 00:24:08.630908 2141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782: Bootstrap starting.
I20260812 00:24:08.623647 2149 master_runner.cc:186] Error getting master registration for 127.18.163.253:39515: OK, instance_id { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" instance_seqno: 1786494247863032 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:24:08.635242 2141 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782: Neither blocks nor log segments found. Creating new log.
I20260812 00:24:08.635571 2149 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:24:08.638206 2141 log.cc:824] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:08.641948 2141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782: No bootstrap required, opened a new log
W20260812 00:24:08.641937 2268 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:24:08.642151 2268 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:24:08.651263 2141 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } }
I20260812 00:24:08.651729 2141 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:08.651892 2141 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff16d75b208f4e92a5daff5409aa1782, State: Initialized, Role: FOLLOWER
I20260812 00:24:08.652585 2141 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } }
I20260812 00:24:08.653657 2272 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } } }
I20260812 00:24:08.654109 2272 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:24:08.654958 2141 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 00:24:08.670225 2172 tablet.cc:2369] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:24:08.676934 2066 master_runner.cc:263] No leader master found from master ff16d75b208f4e92a5daff5409aa1782
I20260812 00:24:08.677105 2066 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 00:24:08.680799 2285 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:24:08.680971 2285 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:24:08.724799 2272 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:24:08.725162 2272 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } }
I20260812 00:24:08.727151 2272 leader_election.cc:288] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63da53274d044e5c82e27b28673a39c3 (127.18.163.254:34041), f3859b6266e742a195bf0cae78d434da (127.18.163.252:33213)
I20260812 00:24:08.728379 2195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff16d75b208f4e92a5daff5409aa1782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3859b6266e742a195bf0cae78d434da" is_pre_election: true
I20260812 00:24:08.729077 2195 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff16d75b208f4e92a5daff5409aa1782 in term 0.
I20260812 00:24:08.730540 2086 leader_election.cc:302] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3859b6266e742a195bf0cae78d434da, ff16d75b208f4e92a5daff5409aa1782; no voters:
I20260812 00:24:08.732748 2028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff16d75b208f4e92a5daff5409aa1782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63da53274d044e5c82e27b28673a39c3" is_pre_election: true
I20260812 00:24:08.733489 2028 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff16d75b208f4e92a5daff5409aa1782 in term 0.
I20260812 00:24:08.734789 2272 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:24:08.734994 2272 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:24:08.735101 2272 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:08.740582 2272 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } }
I20260812 00:24:08.742197 2028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff16d75b208f4e92a5daff5409aa1782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63da53274d044e5c82e27b28673a39c3"
I20260812 00:24:08.742524 2028 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:08.746379 2028 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff16d75b208f4e92a5daff5409aa1782 in term 1.
I20260812 00:24:08.747124 2085 leader_election.cc:302] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63da53274d044e5c82e27b28673a39c3, ff16d75b208f4e92a5daff5409aa1782; no voters:
I20260812 00:24:08.750320 2195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff16d75b208f4e92a5daff5409aa1782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3859b6266e742a195bf0cae78d434da"
I20260812 00:24:08.750607 2195 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:08.758945 2195 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff16d75b208f4e92a5daff5409aa1782 in term 1.
I20260812 00:24:08.762068 2272 leader_election.cc:288] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [CANDIDATE]: Term 1 election: Requested vote from peers 63da53274d044e5c82e27b28673a39c3 (127.18.163.254:34041), f3859b6266e742a195bf0cae78d434da (127.18.163.252:33213)
I20260812 00:24:08.762683 2272 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:24:08.763211 2272 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [term 1 LEADER]: Becoming Leader. State: Replica: ff16d75b208f4e92a5daff5409aa1782, State: Running, Role: LEADER
I20260812 00:24:08.764144 2272 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } }
I20260812 00:24:08.782265 2288 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff16d75b208f4e92a5daff5409aa1782. Latest consensus state: current_term: 1 leader_uuid: "ff16d75b208f4e92a5daff5409aa1782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } } }
I20260812 00:24:08.782872 2288 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [sys.catalog]: This master's current role is: LEADER
I20260812 00:24:08.790377 2290 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:24:08.793097 2290 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:24:08.815450 2195 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da [term 1 FOLLOWER]: Refusing update from remote peer ff16d75b208f4e92a5daff5409aa1782: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:24:08.821611 2288 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:24:08.830042 2028 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3 [term 1 FOLLOWER]: Refusing update from remote peer ff16d75b208f4e92a5daff5409aa1782: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:24:08.831341 2288 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:24:08.851766 2256 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff16d75b208f4e92a5daff5409aa1782. Latest consensus state: current_term: 1 leader_uuid: "ff16d75b208f4e92a5daff5409aa1782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } } }
I20260812 00:24:08.852128 2256 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da [sys.catalog]: This master's current role is: FOLLOWER
W20260812 00:24:08.853960 2089 tablet.cc:2369] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:24:08.857919 2291 mvcc.cc:205] Tried to move back new op lower bound from 7317480443133038592 to 7317480442952437760. Current Snapshot: MvccSnapshot[applied={T|T < 7317480443133038592}]
I20260812 00:24:08.868498 2256 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ff16d75b208f4e92a5daff5409aa1782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } } }
I20260812 00:24:08.868855 2256 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:24:08.868850 2272 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ff16d75b208f4e92a5daff5409aa1782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } } }
I20260812 00:24:08.869215 2272 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [sys.catalog]: This master's current role is: LEADER
I20260812 00:24:08.870303 2234 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff16d75b208f4e92a5daff5409aa1782. Latest consensus state: current_term: 1 leader_uuid: "ff16d75b208f4e92a5daff5409aa1782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } } }
I20260812 00:24:08.870599 2234 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:24:08.871783 2290 catalog_manager.cc:1347] Generated new cluster ID: e53808d8fe01485eaa748126cb40a93c
I20260812 00:24:08.871882 2290 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:24:08.886198 2288 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ff16d75b208f4e92a5daff5409aa1782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } } }
I20260812 00:24:08.887760 2288 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782 [sys.catalog]: This master's current role is: LEADER
I20260812 00:24:08.902691 2234 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ff16d75b208f4e92a5daff5409aa1782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63da53274d044e5c82e27b28673a39c3" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34041 } } peers { permanent_uuid: "ff16d75b208f4e92a5daff5409aa1782" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 39515 } } peers { permanent_uuid: "f3859b6266e742a195bf0cae78d434da" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 33213 } } }
I20260812 00:24:08.902992 2234 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:24:08.942651 2290 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:24:08.950832 2290 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:24:08.981295 2290 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff16d75b208f4e92a5daff5409aa1782: Generated new TSK 0
I20260812 00:24:08.982570 2290 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:24:09.536537 2245 catalog_manager.cc:1259] Loaded cluster ID: e53808d8fe01485eaa748126cb40a93c
I20260812 00:24:09.536700 2245 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3: loading cluster ID for follower catalog manager: success
I20260812 00:24:09.539407 2245 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3: acquiring CA information for follower catalog manager: success
I20260812 00:24:09.541446 2245 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 63da53274d044e5c82e27b28673a39c3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:24:09.644304 2268 catalog_manager.cc:1259] Loaded cluster ID: e53808d8fe01485eaa748126cb40a93c
I20260812 00:24:09.644481 2268 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da: loading cluster ID for follower catalog manager: success
I20260812 00:24:09.647212 2268 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da: acquiring CA information for follower catalog manager: success
I20260812 00:24:09.649298 2268 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f3859b6266e742a195bf0cae78d434da: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:24:10.154426 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 1976
I20260812 00:24:10.155694 2050 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:10.270664 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 1976
I20260812 00:24:10.299551 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 2066
I20260812 00:24:10.300772 2134 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:10.429710 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 2066
W20260812 00:24:10.458596 2168 connection.cc:535] server connection from 127.0.0.1:56502 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:24:10.458910 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 2149
I20260812 00:24:10.460178 2219 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:10.574235 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 2149
2026-08-12T00:24:10Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5335 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:24:10 dist-test-slave-njxd krb5kdc[2312](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:24:10 dist-test-slave-njxd krb5kdc[2312](info): set up 2 sockets
Aug 12 00:24:10 dist-test-slave-njxd krb5kdc[2312](info): commencing operation
krb5kdc: starting...
W20260812 00:24:11.803272 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.002s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:24:12 dist-test-slave-njxd krb5kdc[2312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:24:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:24:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:24:12.158236 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44539
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:38439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:44539
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:24:12.526677 2325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:12.527079 2325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:12.527259 2325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:12.534835 2325 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:24:12.535022 2325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:12.535143 2325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:12.535256 2325 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:24:12.535347 2325 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:24:12.545727 2325 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:38439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:44539
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:12.547284 2325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:12.548771 2325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:12.562357 2332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:12.562405 2335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:12.562449 2333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:12.563644 2325 server_base.cc:1034] running on GCE node
I20260812 00:24:12.564625 2325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:12.566344 2325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:12.567569 2325 hybrid_clock.cc:648] HybridClock initialized: now 1786494252567494 us; error 74 us; skew 500 ppm
I20260812 00:24:12.567971 2325 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:12 dist-test-slave-njxd krb5kdc[2312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494252, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:12.574769 2325 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:24:12.576468 2325 webserver.cc:460] Webserver started at http://127.18.163.254:45217/ using document root <none> and password file <none>
I20260812 00:24:12.577262 2325 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:12.577427 2325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:12.577847 2325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:24:12.581341 2325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "6fcb44f53d9b4d92a84eba551e84d960"
format_stamp: "Formatted at 2026-08-12 00:24:12 on dist-test-slave-njxd"
server_key: "8f0dab812b0946e4a92f4bec8eec7959"
server_key_iv: "3a19ddd5b6302a6b2d64d1c0f6b51bc4"
server_key_version: "encryptionkey@0"
I20260812 00:24:12.582365 2325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "6fcb44f53d9b4d92a84eba551e84d960"
format_stamp: "Formatted at 2026-08-12 00:24:12 on dist-test-slave-njxd"
server_key: "8f0dab812b0946e4a92f4bec8eec7959"
server_key_iv: "3a19ddd5b6302a6b2d64d1c0f6b51bc4"
server_key_version: "encryptionkey@0"
I20260812 00:24:12.588085 2325 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260812 00:24:12.591842 2342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:12.593317 2325 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:24:12.593524 2325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "6fcb44f53d9b4d92a84eba551e84d960"
format_stamp: "Formatted at 2026-08-12 00:24:12 on dist-test-slave-njxd"
server_key: "8f0dab812b0946e4a92f4bec8eec7959"
server_key_iv: "3a19ddd5b6302a6b2d64d1c0f6b51bc4"
server_key_version: "encryptionkey@0"
I20260812 00:24:12.593838 2325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:12.620838 2325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:12.625968 2325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:12.626307 2325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:12.646719 2325 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:44539
I20260812 00:24:12.646740 2401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:44539 every 8 connection(s)
I20260812 00:24:12.648254 2325 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:24:12.652271 2402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:12.653950 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 2325
I20260812 00:24:12.654203 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:24:12.654906 19087 external_mini_cluster.cc:1428] Setting key a52781ab01236cce830561c6a4c65373
I20260812 00:24:12.665524 2402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960: Bootstrap starting.
I20260812 00:24:12.669068 2402 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960: Neither blocks nor log segments found. Creating new log.
I20260812 00:24:12.670260 2402 log.cc:824] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960: Log is configured to *not* fsync() on all Append() calls
Aug 12 00:24:12 dist-test-slave-njxd krb5kdc[2312](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:24:12.673923 2402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960: No bootstrap required, opened a new log
I20260812 00:24:12.682384 2405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:12.657381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53978 (local address 127.18.163.254:44539)
0812 00:24:12.658667 (+ 1286us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:12.658681 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:12.658727 (+ 46us) server_negotiation.cc:407] Connection header received
0812 00:24:12.660476 (+ 1749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:12.660502 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:12.660957 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:12.661327 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:12.663335 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:12.665129 (+ 1794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:12.666778 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:12.667541 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:12.667758 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:12.672630 (+ 4872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:12.672643 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:12.672664 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:12.672711 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:12.677046 (+ 4335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:12.677996 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:12.678006 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:12.678022 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:12.678260 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:12.678683 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:12.678688 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:12.678691 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:12.679502 (+ 811us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:12.679845 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:12.680282 (+ 437us) server_negotiation.cc:299] Negotiation successful
0812 00:24:12.680791 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1030,"thread_start_us":679,"threads_started":1}
I20260812 00:24:12.684824 2402 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fcb44f53d9b4d92a84eba551e84d960" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44539 } }
I20260812 00:24:12.685316 2402 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:12.685433 2402 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fcb44f53d9b4d92a84eba551e84d960, State: Initialized, Role: FOLLOWER
I20260812 00:24:12.686220 2402 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fcb44f53d9b4d92a84eba551e84d960" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44539 } }
I20260812 00:24:12.686540 2402 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:24:12.686746 2402 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:24:12.686885 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:24:12.686940 2402 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:12.689302 2402 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fcb44f53d9b4d92a84eba551e84d960" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44539 } }
I20260812 00:24:12.689960 2402 leader_election.cc:302] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6fcb44f53d9b4d92a84eba551e84d960; no voters:
I20260812 00:24:12.690661 2402 leader_election.cc:288] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:24:12.690816 2407 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:24:12.691615 2407 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [term 1 LEADER]: Becoming Leader. State: Replica: 6fcb44f53d9b4d92a84eba551e84d960, State: Running, Role: LEADER
I20260812 00:24:12.692226 2407 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fcb44f53d9b4d92a84eba551e84d960" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44539 } }
I20260812 00:24:12.692878 2402 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:24:12.695902 2408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6fcb44f53d9b4d92a84eba551e84d960" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fcb44f53d9b4d92a84eba551e84d960" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44539 } } }
I20260812 00:24:12.696324 2408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [sys.catalog]: This master's current role is: LEADER
I20260812 00:24:12.695998 2410 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6fcb44f53d9b4d92a84eba551e84d960. Latest consensus state: current_term: 1 leader_uuid: "6fcb44f53d9b4d92a84eba551e84d960" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fcb44f53d9b4d92a84eba551e84d960" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44539 } } }
I20260812 00:24:12.696460 2410 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960 [sys.catalog]: This master's current role is: LEADER
I20260812 00:24:12.702355 2416 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:24:12.708459 2416 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:24:12.718562 2416 catalog_manager.cc:1347] Generated new cluster ID: dc0c6fd35ae545958e50b62a44d3449c
I20260812 00:24:12.718711 2416 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:24:12.744935 2416 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:24:12.747437 2416 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:24:12.758004 2416 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6fcb44f53d9b4d92a84eba551e84d960: Generated new TSK 0
I20260812 00:24:12.758960 2416 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:24:12.800091 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 2325
I20260812 00:24:12.801452 2397 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:12.902631 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 2325
2026-08-12T00:24:12Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2322 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:24:13 dist-test-slave-njxd krb5kdc[2434](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:24:13 dist-test-slave-njxd krb5kdc[2434](info): set up 2 sockets
Aug 12 00:24:13 dist-test-slave-njxd krb5kdc[2434](info): commencing operation
krb5kdc: starting...
W20260812 00:24:14.112891 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.001s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:24:14 dist-test-slave-njxd krb5kdc[2434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:24:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:24:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:24:14.466883 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:46211
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:46211
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:24:14.837049 2451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:14.837383 2451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:14.837489 2451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:14.844971 2451 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:24:14.845096 2451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:14.845144 2451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:14.845204 2451 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:24:14.845249 2451 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:24:14.855705 2451 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:46211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:46211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:14.857179 2451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:14.858642 2451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:14.871824 2460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:14.871759 2458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:14.872390 2457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:14.872718 2451 server_base.cc:1034] running on GCE node
I20260812 00:24:14.873741 2451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:14.875391 2451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:14.876653 2451 hybrid_clock.cc:648] HybridClock initialized: now 1786494254876593 us; error 59 us; skew 500 ppm
I20260812 00:24:14.877050 2451 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:14 dist-test-slave-njxd krb5kdc[2434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494254, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:14.880527 2451 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:24:14.882244 2451 webserver.cc:460] Webserver started at http://127.18.163.254:39733/ using document root <none> and password file <none>
I20260812 00:24:14.882967 2451 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:14.883085 2451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:14.883380 2451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:24:14.886875 2451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "53a739f789534f158d19d92fb66adfaa"
format_stamp: "Formatted at 2026-08-12 00:24:14 on dist-test-slave-njxd"
server_key: "557a850bc2d10106142de43423d5db31"
server_key_iv: "3d70a9681c33502dbc0d7f25ddbf232a"
server_key_version: "encryptionkey@0"
I20260812 00:24:14.887682 2451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "53a739f789534f158d19d92fb66adfaa"
format_stamp: "Formatted at 2026-08-12 00:24:14 on dist-test-slave-njxd"
server_key: "557a850bc2d10106142de43423d5db31"
server_key_iv: "3d70a9681c33502dbc0d7f25ddbf232a"
server_key_version: "encryptionkey@0"
I20260812 00:24:14.893501 2451 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 00:24:14.897336 2470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:14.899009 2451 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:24:14.899186 2451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "53a739f789534f158d19d92fb66adfaa"
format_stamp: "Formatted at 2026-08-12 00:24:14 on dist-test-slave-njxd"
server_key: "557a850bc2d10106142de43423d5db31"
server_key_iv: "3d70a9681c33502dbc0d7f25ddbf232a"
server_key_version: "encryptionkey@0"
I20260812 00:24:14.899394 2451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:14.924897 2451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:14.929184 2451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:14.929454 2451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:14.950131 2451 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:46211
I20260812 00:24:14.950174 2524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:46211 every 8 connection(s)
I20260812 00:24:14.951660 2451 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:24:14.953317 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 2451
I20260812 00:24:14.953564 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:24:14.954505 19087 external_mini_cluster.cc:1428] Setting key 7f50af21e8fb2b2c3e07ce1e09fff11b
I20260812 00:24:14.956802 2525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:14.969116 2525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa: Bootstrap starting.
Aug 12 00:24:14 dist-test-slave-njxd krb5kdc[2434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:24:14.973111 2525 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa: Neither blocks nor log segments found. Creating new log.
I20260812 00:24:14.974474 2525 log.cc:824] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:14.978536 2525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa: No bootstrap required, opened a new log
I20260812 00:24:14.979704 2528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:14.956868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42756 (local address 127.18.163.254:46211)
0812 00:24:14.957755 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:14.957767 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:14.957810 (+ 43us) server_negotiation.cc:407] Connection header received
0812 00:24:14.959541 (+ 1731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:14.959564 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:14.960002 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:14.960483 (+ 481us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:14.962145 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:14.963534 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:14.964945 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:14.965791 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:14.966027 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:14.970553 (+ 4526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:14.970562 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:14.970578 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:14.970634 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:14.974236 (+ 3602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:14.975250 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:14.975261 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:14.975271 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:14.975492 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:14.976035 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:14.976040 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:14.976043 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:14.976849 (+ 806us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:14.977197 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:14.977678 (+ 481us) server_negotiation.cc:299] Negotiation successful
0812 00:24:14.978197 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":380,"threads_started":1}
I20260812 00:24:14.987739 2525 raft_consensus.cc:348] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } }
I20260812 00:24:14.988209 2525 raft_consensus.cc:374] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:14.988337 2525 raft_consensus.cc:729] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a739f789534f158d19d92fb66adfaa, State: Initialized, Role: FOLLOWER
I20260812 00:24:14.988961 2525 consensus_queue.cc:260] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } }
I20260812 00:24:14.989236 2525 raft_consensus.cc:388] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:24:14.989403 2525 raft_consensus.cc:482] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:24:14.989578 2525 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:14.992023 2525 raft_consensus.cc:504] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } }
I20260812 00:24:14.992624 2525 leader_election.cc:302] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 53a739f789534f158d19d92fb66adfaa; no voters:
I20260812 00:24:14.993393 2525 leader_election.cc:288] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:24:14.993551 2530 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:24:14.994750 2530 raft_consensus.cc:686] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 1 LEADER]: Becoming Leader. State: Replica: 53a739f789534f158d19d92fb66adfaa, State: Running, Role: LEADER
I20260812 00:24:14.995416 2530 consensus_queue.cc:237] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } }
I20260812 00:24:14.996207 2525 sys_catalog.cc:564] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:24:14.998711 2531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "53a739f789534f158d19d92fb66adfaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } } }
I20260812 00:24:14.999150 2531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [sys.catalog]: This master's current role is: LEADER
I20260812 00:24:14.998974 2532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 53a739f789534f158d19d92fb66adfaa. Latest consensus state: current_term: 1 leader_uuid: "53a739f789534f158d19d92fb66adfaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } } }
I20260812 00:24:14.999444 2532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [sys.catalog]: This master's current role is: LEADER
I20260812 00:24:15.002295 2539 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:24:15.008628 2539 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:24:15.019433 2539 catalog_manager.cc:1347] Generated new cluster ID: 80b95eb89bce4a8fbdcc6c7367a98bae
I20260812 00:24:15.019589 2539 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:24:15.046126 2539 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:24:15.048190 2539 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:24:15.061934 2539 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa: Generated new TSK 0
I20260812 00:24:15.062899 2539 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:24:15.163137 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:46211
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:24:15.546140 2552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:15.546490 2552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:15.546605 2552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:15.554317 2552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:15.554457 2552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:15.554600 2552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:24:15.565325 2552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:46211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:15.566843 2552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:15.568311 2552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:15.581919 2558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:15.581931 2557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:15.583338 2561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:15.584339 2552 server_base.cc:1034] running on GCE node
I20260812 00:24:15.585008 2552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:15.586272 2552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:15.587519 2552 hybrid_clock.cc:648] HybridClock initialized: now 1786494255587475 us; error 47 us; skew 500 ppm
I20260812 00:24:15.587929 2552 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:15 dist-test-slave-njxd krb5kdc[2434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494255, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:15.591365 2552 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:24:15.592903 2552 webserver.cc:460] Webserver started at http://127.18.163.193:33419/ using document root <none> and password file <none>
I20260812 00:24:15.593678 2552 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:15.593792 2552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:15.594054 2552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:24:15.597551 2552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "8611d5a3e47b419f86e4eedc75491313"
format_stamp: "Formatted at 2026-08-12 00:24:15 on dist-test-slave-njxd"
server_key: "20b920b8e53247a41fa7abb4f212e178"
server_key_iv: "bfcce5b80d18d18f011aa31fdd655c23"
server_key_version: "encryptionkey@0"
I20260812 00:24:15.598455 2552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "8611d5a3e47b419f86e4eedc75491313"
format_stamp: "Formatted at 2026-08-12 00:24:15 on dist-test-slave-njxd"
server_key: "20b920b8e53247a41fa7abb4f212e178"
server_key_iv: "bfcce5b80d18d18f011aa31fdd655c23"
server_key_version: "encryptionkey@0"
I20260812 00:24:15.604466 2552 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260812 00:24:15.608320 2569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:15.609941 2552 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:24:15.610113 2552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "8611d5a3e47b419f86e4eedc75491313"
format_stamp: "Formatted at 2026-08-12 00:24:15 on dist-test-slave-njxd"
server_key: "20b920b8e53247a41fa7abb4f212e178"
server_key_iv: "bfcce5b80d18d18f011aa31fdd655c23"
server_key_version: "encryptionkey@0"
I20260812 00:24:15.610309 2552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:15.631381 2552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:15.635767 2552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:15.636061 2552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:15.637089 2552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:24:15.638593 2552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:24:15.638676 2552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:15.638769 2552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:24:15.638814 2552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:15.675046 2552 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:34127
I20260812 00:24:15.675091 2693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:34127 every 8 connection(s)
I20260812 00:24:15.676484 2552 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:24:15.680282 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 2552
I20260812 00:24:15.680522 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:24:15.681267 19087 external_mini_cluster.cc:1428] Setting key 0a930a92cf186d8e358d819ed838cb52
Aug 12 00:24:15 dist-test-slave-njxd krb5kdc[2434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494255, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:24:15.698868 2697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:15.679298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:37751 (local address 127.18.163.254:46211)
0812 00:24:15.679780 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:15.679786 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:15.681031 (+ 1245us) server_negotiation.cc:407] Connection header received
0812 00:24:15.683086 (+ 2055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:15.683092 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:15.683198 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:15.683318 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:15.684971 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:15.685807 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:15.687671 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:15.688072 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:15.688232 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:15.692415 (+ 4183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:15.692420 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:15.692423 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:15.692468 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:15.695317 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:15.696190 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:15.696195 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:15.696199 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:15.696342 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:15.696848 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:15.696854 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:15.696857 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:15.697162 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:15.697328 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:15.698215 (+ 887us) server_negotiation.cc:299] Negotiation successful
0812 00:24:15.698476 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":241,"threads_started":1}
I20260812 00:24:15.699990 2698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:15.679935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:37751)
0812 00:24:15.680833 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:15.680881 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:15.682785 (+ 1904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:15.683597 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:15.683612 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:15.684163 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:15.684778 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:15.684798 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:15.685984 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:15.685990 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:15.687469 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:15.687483 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:15.688352 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:15.688360 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:15.688622 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:15.689384 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:15.689414 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:15.692120 (+ 2706us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:15.695497 (+ 3377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:15.695508 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:15.695528 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:15.696044 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:15.696484 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:15.696489 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:15.696492 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:15.696729 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:15.697299 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:15.697308 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:15.697804 (+ 496us) client_negotiation.cc:769] Sending connection context
0812 00:24:15.698098 (+ 294us) client_negotiation.cc:240] Negotiation successful
0812 00:24:15.698712 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":382,"threads_started":1}
I20260812 00:24:15.701866 2694 heartbeater.cc:347] Connected to a master server at 127.18.163.254:46211
I20260812 00:24:15.702250 2694 heartbeater.cc:464] Registering TS with master...
I20260812 00:24:15.703395 2694 heartbeater.cc:511] Master 127.18.163.254:46211 requested a full tablet report, sending...
I20260812 00:24:15.705955 2487 ts_manager.cc:194] Registered new tserver with Master: 8611d5a3e47b419f86e4eedc75491313 (127.18.163.193:34127)
I20260812 00:24:15.707480 2487 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:37751
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:24:15.758082 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:46211
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:24:16.139613 2702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:16.139952 2702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:16.140146 2702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:16.147895 2702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:16.148049 2702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:16.148267 2702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:24:16.158983 2702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:46211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:16.160529 2702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:16.162114 2702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:16.176852 2708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:16.176939 2710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:16.176967 2707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:16.177994 2702 server_base.cc:1034] running on GCE node
I20260812 00:24:16.178761 2702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:16.179876 2702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:16.181166 2702 hybrid_clock.cc:648] HybridClock initialized: now 1786494256181106 us; error 76 us; skew 500 ppm
I20260812 00:24:16.181561 2702 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:16 dist-test-slave-njxd krb5kdc[2434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494256, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:16.185175 2702 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:24:16.187167 2702 webserver.cc:460] Webserver started at http://127.18.163.194:41271/ using document root <none> and password file <none>
I20260812 00:24:16.188112 2702 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:16.188292 2702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:16.188658 2702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:24:16.192157 2702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "cb8052ffb89d474599cbd102f1268ea9"
format_stamp: "Formatted at 2026-08-12 00:24:16 on dist-test-slave-njxd"
server_key: "fbc3f93c46d37a41c99c7d6e27589a2c"
server_key_iv: "856481721044f5701ec4934029ef0e4b"
server_key_version: "encryptionkey@0"
I20260812 00:24:16.193198 2702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "cb8052ffb89d474599cbd102f1268ea9"
format_stamp: "Formatted at 2026-08-12 00:24:16 on dist-test-slave-njxd"
server_key: "fbc3f93c46d37a41c99c7d6e27589a2c"
server_key_iv: "856481721044f5701ec4934029ef0e4b"
server_key_version: "encryptionkey@0"
I20260812 00:24:16.199700 2702 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:24:16.203835 2718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:16.205361 2702 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:24:16.205662 2702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "cb8052ffb89d474599cbd102f1268ea9"
format_stamp: "Formatted at 2026-08-12 00:24:16 on dist-test-slave-njxd"
server_key: "fbc3f93c46d37a41c99c7d6e27589a2c"
server_key_iv: "856481721044f5701ec4934029ef0e4b"
server_key_version: "encryptionkey@0"
I20260812 00:24:16.205912 2702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:16.232618 2702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:16.236943 2702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:16.237277 2702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:16.238421 2702 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:24:16.239909 2702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:24:16.240021 2702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:16.240182 2702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:24:16.240260 2702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:16.277087 2702 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:43263
I20260812 00:24:16.277160 2851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:43263 every 8 connection(s)
I20260812 00:24:16.278724 2702 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:24:16.284413 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 2702
I20260812 00:24:16.284637 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:24:16.285123 19087 external_mini_cluster.cc:1428] Setting key d1e9d3166cf9506be3b657440d72b006
Aug 12 00:24:16 dist-test-slave-njxd krb5kdc[2434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494256, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:24:16.303238 2854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:16.281693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:45475 (local address 127.18.163.254:46211)
0812 00:24:16.282178 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:16.282183 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:16.283357 (+ 1174us) server_negotiation.cc:407] Connection header received
0812 00:24:16.285664 (+ 2307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:16.285672 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:16.285787 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:16.285921 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:16.287796 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.288554 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.290385 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.290846 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.291004 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:16.295679 (+ 4675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:16.295685 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:16.295693 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:16.295735 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:16.298826 (+ 3091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:16.300004 (+ 1178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:16.300009 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:16.300011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:16.300166 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:16.300819 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:16.300823 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:16.300825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:16.301213 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:16.301340 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:16.302387 (+ 1047us) server_negotiation.cc:299] Negotiation successful
0812 00:24:16.302749 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":239,"threads_started":1}
I20260812 00:24:16.304376 2856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:16.282359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:45475)
0812 00:24:16.283163 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:16.283217 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:16.285274 (+ 2057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:16.286223 (+ 949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:16.286233 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:16.286840 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:16.287578 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:16.287617 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.288739 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.288752 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:16.290204 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:16.290225 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.291125 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.291133 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:16.291404 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:16.292174 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:16.292206 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:16.295325 (+ 3119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:16.299040 (+ 3715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:16.299054 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:16.299079 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:16.299843 (+ 764us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:16.300291 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:16.300298 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:16.300304 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:16.300670 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:16.301350 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:16.301362 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:16.301927 (+ 565us) client_negotiation.cc:769] Sending connection context
0812 00:24:16.302263 (+ 336us) client_negotiation.cc:240] Negotiation successful
0812 00:24:16.302876 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":308,"threads_started":1}
I20260812 00:24:16.306146 2852 heartbeater.cc:347] Connected to a master server at 127.18.163.254:46211
I20260812 00:24:16.306504 2852 heartbeater.cc:464] Registering TS with master...
I20260812 00:24:16.307322 2852 heartbeater.cc:511] Master 127.18.163.254:46211 requested a full tablet report, sending...
I20260812 00:24:16.309005 2487 ts_manager.cc:194] Registered new tserver with Master: cb8052ffb89d474599cbd102f1268ea9 (127.18.163.194:43263)
I20260812 00:24:16.310098 2487 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:45475
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
I20260812 00:24:16.361718 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:46211
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:24:16.711750 2694 heartbeater.cc:503] Master 127.18.163.254:46211 was elected leader, sending a full tablet report...
W20260812 00:24:16.739193 2860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:16.739497 2860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:16.739596 2860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:16.747243 2860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:16.747377 2860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:16.747514 2860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:24:16.757680 2860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:46211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:16.759075 2860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:16.760497 2860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:16.774737 2865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:16.774806 2869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:16.774830 2866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:16.775591 2860 server_base.cc:1034] running on GCE node
I20260812 00:24:16.776317 2860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:16.777537 2860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:16.778838 2860 hybrid_clock.cc:648] HybridClock initialized: now 1786494256778791 us; error 45 us; skew 500 ppm
I20260812 00:24:16.779199 2860 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:16 dist-test-slave-njxd krb5kdc[2434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494256, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:16.782680 2860 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:24:16.784251 2860 webserver.cc:460] Webserver started at http://127.18.163.195:34391/ using document root <none> and password file <none>
I20260812 00:24:16.785025 2860 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:16.785199 2860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:16.785531 2860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:24:16.789018 2860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "ba44cb7f8af944aeaf4e8c34a8677330"
format_stamp: "Formatted at 2026-08-12 00:24:16 on dist-test-slave-njxd"
server_key: "279955db5d0b9207c725ad1e033d63bc"
server_key_iv: "fffd6a7f4110219ba8b7e22e10594c43"
server_key_version: "encryptionkey@0"
I20260812 00:24:16.789994 2860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "ba44cb7f8af944aeaf4e8c34a8677330"
format_stamp: "Formatted at 2026-08-12 00:24:16 on dist-test-slave-njxd"
server_key: "279955db5d0b9207c725ad1e033d63bc"
server_key_iv: "fffd6a7f4110219ba8b7e22e10594c43"
server_key_version: "encryptionkey@0"
I20260812 00:24:16.795800 2860 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:24:16.800194 2877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:16.801946 2860 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:24:16.802174 2860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "ba44cb7f8af944aeaf4e8c34a8677330"
format_stamp: "Formatted at 2026-08-12 00:24:16 on dist-test-slave-njxd"
server_key: "279955db5d0b9207c725ad1e033d63bc"
server_key_iv: "fffd6a7f4110219ba8b7e22e10594c43"
server_key_version: "encryptionkey@0"
I20260812 00:24:16.802412 2860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:16.820699 2860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:16.824991 2860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:16.825335 2860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:16.826416 2860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:24:16.827958 2860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:24:16.828064 2860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:16.828251 2860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:24:16.828327 2860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:16.863739 2860 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:33545
I20260812 00:24:16.863791 3006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:33545 every 8 connection(s)
I20260812 00:24:16.865166 2860 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:24:16.868919 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 2860
I20260812 00:24:16.869143 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:24:16.869724 19087 external_mini_cluster.cc:1428] Setting key 0db37ff17721b82ded0f873429174996
Aug 12 00:24:16 dist-test-slave-njxd krb5kdc[2434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494256, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:24:16.888166 3009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:16.868028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:39843 (local address 127.18.163.254:46211)
0812 00:24:16.868615 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:16.868623 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:16.869675 (+ 1052us) server_negotiation.cc:407] Connection header received
0812 00:24:16.872321 (+ 2646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:16.872326 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:16.872442 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:16.872603 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:16.874442 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.875291 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.877001 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.877427 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.877538 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:16.881556 (+ 4018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:16.881562 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:16.881565 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:16.881666 (+ 101us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:16.884530 (+ 2864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:16.885709 (+ 1179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:16.885713 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:16.885716 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:16.885854 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:16.886454 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:16.886459 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:16.886461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:16.886775 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:16.886905 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:16.887654 (+ 749us) server_negotiation.cc:299] Negotiation successful
0812 00:24:16.887858 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":278,"threads_started":1}
I20260812 00:24:16.889387 3010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:16.868570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:39843)
0812 00:24:16.869456 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:16.869523 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:16.871999 (+ 2476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:16.872866 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:16.872884 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:16.873528 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:16.874253 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:16.874275 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.875495 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.875499 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:16.876825 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:16.876839 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.877720 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.877727 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:16.877945 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:16.878725 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:16.878756 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:16.881278 (+ 2522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:16.884772 (+ 3494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:16.884783 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:16.884803 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:16.885507 (+ 704us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:16.885982 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:16.885989 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:16.885995 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:16.886312 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:16.886892 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:16.886898 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:16.887290 (+ 392us) client_negotiation.cc:769] Sending connection context
0812 00:24:16.887538 (+ 248us) client_negotiation.cc:240] Negotiation successful
0812 00:24:16.888008 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":373,"threads_started":1}
I20260812 00:24:16.891156 3007 heartbeater.cc:347] Connected to a master server at 127.18.163.254:46211
I20260812 00:24:16.891470 3007 heartbeater.cc:464] Registering TS with master...
I20260812 00:24:16.892270 3007 heartbeater.cc:511] Master 127.18.163.254:46211 requested a full tablet report, sending...
I20260812 00:24:16.893958 2487 ts_manager.cc:194] Registered new tserver with Master: ba44cb7f8af944aeaf4e8c34a8677330 (127.18.163.195:33545)
I20260812 00:24:16.894914 2487 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:39843
I20260812 00:24:16.899041 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:24:16.917490 3009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:16.903800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42772 (local address 127.18.163.254:46211)
0812 00:24:16.904019 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:16.904025 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:16.904562 (+ 537us) server_negotiation.cc:407] Connection header received
0812 00:24:16.904693 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:16.904697 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:16.904766 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:16.904859 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:16.906380 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.907276 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.908672 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.909083 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.909182 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:16.911989 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:16.911994 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:16.911997 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:16.912045 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:16.914811 (+ 2766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:16.915654 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:16.915659 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:16.915661 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:16.915793 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:16.916162 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:16.916165 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:16.916167 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:16.916502 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:16.916717 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:16.917054 (+ 337us) server_negotiation.cc:299] Negotiation successful
0812 00:24:16.917250 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 00:24:16.921985 2487 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42772:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:24:16.929126 2487 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:24:16.980528 3020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:16.942396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:34127 (local address 127.0.0.1:39232)
0812 00:24:16.957328 (+ 14932us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:16.957412 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:16.957735 (+ 323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:16.967965 (+ 10230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:16.967976 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:16.968015 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:16.968559 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:16.968573 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.972438 (+ 3865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.972444 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:16.975123 (+ 2679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:16.976443 (+ 1320us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.978623 (+ 2180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.978633 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:16.979034 (+ 401us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:16.979098 (+ 64us) client_negotiation.cc:769] Sending connection context
0812 00:24:16.979741 (+ 643us) client_negotiation.cc:240] Negotiation successful
0812 00:24:16.979999 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14479,"mutex_wait_us":67,"thread_start_us":15615,"threads_started":1}
I20260812 00:24:16.980931 3023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:16.942772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39232 (local address 127.18.163.193:34127)
0812 00:24:16.965950 (+ 23178us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:16.965965 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:16.966010 (+ 45us) server_negotiation.cc:407] Connection header received
0812 00:24:16.966176 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:16.966189 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:16.966582 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:16.968801 (+ 2219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:16.969157 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.971295 (+ 2138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.976698 (+ 5403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.978351 (+ 1653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.979016 (+ 665us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:16.979241 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:16.980381 (+ 1140us) server_negotiation.cc:299] Negotiation successful
0812 00:24:16.980595 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22890,"thread_start_us":24815,"threads_started":1}
I20260812 00:24:16.982580 3022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:16.942667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:43263 (local address 127.0.0.1:36078)
0812 00:24:16.967352 (+ 24685us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:16.967375 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:16.967499 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:16.972881 (+ 5382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:16.972894 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:16.972933 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:16.973665 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:16.973685 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.976444 (+ 2759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.976453 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:16.979469 (+ 3016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:16.979486 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.981621 (+ 2135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.981628 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:16.981821 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:16.981855 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:24:16.981924 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 00:24:16.982066 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24537,"mutex_wait_us":87,"thread_start_us":24366,"threads_started":1}
I20260812 00:24:16.983652 3024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:16.942924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36078 (local address 127.18.163.194:43263)
0812 00:24:16.972007 (+ 29083us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:16.972021 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:16.972066 (+ 45us) server_negotiation.cc:407] Connection header received
0812 00:24:16.972211 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:16.972224 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:16.972579 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:16.973988 (+ 1409us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:16.974329 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.976242 (+ 1913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.979689 (+ 3447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.981355 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.982905 (+ 1550us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:16.983095 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:16.983177 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 00:24:16.983353 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28841,"thread_start_us":28691,"threads_started":1}
I20260812 00:24:16.985255 2624 tablet_service.cc:1467] Processing CreateTablet for tablet c64c11e360a24a99985397243401ea4f (DEFAULT_TABLE table=test-table [id=05066c5085294deeb4d4c328e8e98cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:24:16.986886 2624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c64c11e360a24a99985397243401ea4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:16.987010 2775 tablet_service.cc:1467] Processing CreateTablet for tablet c64c11e360a24a99985397243401ea4f (DEFAULT_TABLE table=test-table [id=05066c5085294deeb4d4c328e8e98cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:24:16.988981 2775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c64c11e360a24a99985397243401ea4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:16.989771 3025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:16.967852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39356 (local address 127.18.163.195:33545)
0812 00:24:16.979867 (+ 12015us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:16.979876 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:16.980725 (+ 849us) server_negotiation.cc:407] Connection header received
0812 00:24:16.980850 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:16.980859 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:16.981169 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:16.981688 (+ 519us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:16.982704 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.984319 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.986757 (+ 2438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.988243 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.988457 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:16.988653 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:16.989202 (+ 549us) server_negotiation.cc:299] Negotiation successful
0812 00:24:16.989382 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11771,"thread_start_us":11577,"threads_started":1}
I20260812 00:24:16.990345 3026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:16.974756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:33545 (local address 127.0.0.1:39356)
0812 00:24:16.980403 (+ 5647us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:16.980425 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:16.980581 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:16.982008 (+ 1427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:16.982013 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:16.982037 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:16.982507 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:16.982523 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.984500 (+ 1977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.984505 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:16.986553 (+ 2048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:16.986570 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:16.988475 (+ 1905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:16.988482 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:16.988672 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:16.988727 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 00:24:16.988834 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 00:24:16.989987 (+ 1153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5509,"thread_start_us":5308,"threads_started":1}
I20260812 00:24:16.994588 2930 tablet_service.cc:1467] Processing CreateTablet for tablet c64c11e360a24a99985397243401ea4f (DEFAULT_TABLE table=test-table [id=05066c5085294deeb4d4c328e8e98cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:24:16.996143 2930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c64c11e360a24a99985397243401ea4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:17.001695 3027 tablet_bootstrap.cc:492] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9: Bootstrap starting.
I20260812 00:24:17.002678 3028 tablet_bootstrap.cc:492] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313: Bootstrap starting.
I20260812 00:24:17.006379 3027 tablet_bootstrap.cc:654] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9: Neither blocks nor log segments found. Creating new log.
I20260812 00:24:17.006383 3028 tablet_bootstrap.cc:654] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313: Neither blocks nor log segments found. Creating new log.
I20260812 00:24:17.007910 3028 log.cc:824] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:17.007885 3027 log.cc:824] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:17.011478 3028 tablet_bootstrap.cc:492] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313: No bootstrap required, opened a new log
I20260812 00:24:17.011597 3032 tablet_bootstrap.cc:492] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330: Bootstrap starting.
I20260812 00:24:17.011917 3028 ts_tablet_manager.cc:1397] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260812 00:24:17.012133 3027 tablet_bootstrap.cc:492] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9: No bootstrap required, opened a new log
I20260812 00:24:17.012485 3027 ts_tablet_manager.cc:1397] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20260812 00:24:17.015622 3032 tablet_bootstrap.cc:654] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330: Neither blocks nor log segments found. Creating new log.
I20260812 00:24:17.017031 3032 log.cc:824] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:17.020529 3032 tablet_bootstrap.cc:492] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330: No bootstrap required, opened a new log
I20260812 00:24:17.020341 3028 raft_consensus.cc:348] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } }
I20260812 00:24:17.020815 3028 raft_consensus.cc:374] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:17.020841 3032 ts_tablet_manager.cc:1397] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260812 00:24:17.020952 3028 raft_consensus.cc:729] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8611d5a3e47b419f86e4eedc75491313, State: Initialized, Role: FOLLOWER
I20260812 00:24:17.021695 3028 consensus_queue.cc:260] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } }
I20260812 00:24:17.023612 3028 ts_tablet_manager.cc:1428] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260812 00:24:17.024006 3027 raft_consensus.cc:348] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } }
I20260812 00:24:17.024514 3027 raft_consensus.cc:374] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:17.024638 3027 raft_consensus.cc:729] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb8052ffb89d474599cbd102f1268ea9, State: Initialized, Role: FOLLOWER
I20260812 00:24:17.025323 3027 consensus_queue.cc:260] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } }
I20260812 00:24:17.026666 2852 heartbeater.cc:503] Master 127.18.163.254:46211 was elected leader, sending a full tablet report...
I20260812 00:24:17.027411 3027 ts_tablet_manager.cc:1428] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
W20260812 00:24:17.031037 2853 tablet.cc:2369] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:24:17.032235 3032 raft_consensus.cc:348] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } }
I20260812 00:24:17.032682 3032 raft_consensus.cc:374] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:17.032799 3032 raft_consensus.cc:729] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba44cb7f8af944aeaf4e8c34a8677330, State: Initialized, Role: FOLLOWER
I20260812 00:24:17.033527 3032 consensus_queue.cc:260] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } }
I20260812 00:24:17.034716 3007 heartbeater.cc:503] Master 127.18.163.254:46211 was elected leader, sending a full tablet report...
I20260812 00:24:17.035509 3032 ts_tablet_manager.cc:1428] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330: Time spent starting tablet: real 0.015s user 0.014s sys 0.001s
W20260812 00:24:17.116956 3008 tablet.cc:2369] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:24:17.155254 3034 raft_consensus.cc:482] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:24:17.155592 3034 raft_consensus.cc:504] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } }
I20260812 00:24:17.157387 3034 leader_election.cc:288] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb8052ffb89d474599cbd102f1268ea9 (127.18.163.194:43263), ba44cb7f8af944aeaf4e8c34a8677330 (127.18.163.195:33545)
I20260812 00:24:17.164355 3024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:17.157979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:34665 (local address 127.18.163.194:43263)
0812 00:24:17.158250 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:17.158260 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:17.158707 (+ 447us) server_negotiation.cc:407] Connection header received
0812 00:24:17.159013 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:17.159022 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:17.159128 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:17.159227 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:17.159915 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:17.160622 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:17.162557 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:17.163349 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:17.163545 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:17.163624 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:17.163927 (+ 303us) server_negotiation.cc:299] Negotiation successful
0812 00:24:17.164062 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 00:24:17.164533 3037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:17.157903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:43263 (local address 127.18.163.193:34665)
0812 00:24:17.158565 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:17.158594 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:17.158810 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:17.159330 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:17.159335 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:17.159367 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:17.159756 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:17.159765 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:17.160791 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:17.160800 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:17.162381 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:17.162394 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:17.163575 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:17.163582 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:17.163758 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:17.163784 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 00:24:17.163897 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 00:24:17.164037 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"mutex_wait_us":21,"thread_start_us":388,"threads_started":1}
I20260812 00:24:17.164817 3025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:17.159018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:59293 (local address 127.18.163.195:33545)
0812 00:24:17.159266 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:17.159273 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:17.159546 (+ 273us) server_negotiation.cc:407] Connection header received
0812 00:24:17.159778 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:17.159784 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:17.159854 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:17.159952 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:17.160470 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:17.161300 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:17.163078 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:17.163866 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:17.164055 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:17.164145 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:17.164425 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 00:24:17.164563 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260812 00:24:17.164969 3038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:17.158755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:33545 (local address 127.18.163.193:59293)
0812 00:24:17.159430 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:17.159452 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:17.159628 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:17.159972 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:17.159976 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:17.160000 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:17.160315 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:17.160324 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:17.161449 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:17.161460 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:17.162916 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:17.162928 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:17.164096 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:17.164103 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:17.164264 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:17.164287 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 00:24:17.164399 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 00:24:17.164532 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"mutex_wait_us":1,"thread_start_us":309,"threads_started":1}
I20260812 00:24:17.165822 2802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c64c11e360a24a99985397243401ea4f" candidate_uuid: "8611d5a3e47b419f86e4eedc75491313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb8052ffb89d474599cbd102f1268ea9" is_pre_election: true
I20260812 00:24:17.166091 2953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c64c11e360a24a99985397243401ea4f" candidate_uuid: "8611d5a3e47b419f86e4eedc75491313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" is_pre_election: true
I20260812 00:24:17.166409 2802 raft_consensus.cc:2454] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8611d5a3e47b419f86e4eedc75491313 in term 0.
I20260812 00:24:17.166685 2953 raft_consensus.cc:2454] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8611d5a3e47b419f86e4eedc75491313 in term 0.
I20260812 00:24:17.167210 2573 leader_election.cc:302] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8611d5a3e47b419f86e4eedc75491313, cb8052ffb89d474599cbd102f1268ea9; no voters:
I20260812 00:24:17.167678 3034 raft_consensus.cc:2781] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:24:17.167841 3034 raft_consensus.cc:482] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:24:17.167970 3034 raft_consensus.cc:3037] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:17.170446 3034 raft_consensus.cc:504] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } }
I20260812 00:24:17.171108 3034 leader_election.cc:288] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [CANDIDATE]: Term 1 election: Requested vote from peers cb8052ffb89d474599cbd102f1268ea9 (127.18.163.194:43263), ba44cb7f8af944aeaf4e8c34a8677330 (127.18.163.195:33545)
I20260812 00:24:17.171761 2802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c64c11e360a24a99985397243401ea4f" candidate_uuid: "8611d5a3e47b419f86e4eedc75491313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb8052ffb89d474599cbd102f1268ea9"
I20260812 00:24:17.171814 2953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c64c11e360a24a99985397243401ea4f" candidate_uuid: "8611d5a3e47b419f86e4eedc75491313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba44cb7f8af944aeaf4e8c34a8677330"
I20260812 00:24:17.171995 2802 raft_consensus.cc:3037] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:17.172043 2953 raft_consensus.cc:3037] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:17.174477 2802 raft_consensus.cc:2454] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8611d5a3e47b419f86e4eedc75491313 in term 1.
I20260812 00:24:17.174499 2953 raft_consensus.cc:2454] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8611d5a3e47b419f86e4eedc75491313 in term 1.
I20260812 00:24:17.175024 2573 leader_election.cc:302] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8611d5a3e47b419f86e4eedc75491313, cb8052ffb89d474599cbd102f1268ea9; no voters:
I20260812 00:24:17.175381 3034 raft_consensus.cc:2781] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:24:17.175881 3034 raft_consensus.cc:686] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [term 1 LEADER]: Becoming Leader. State: Replica: 8611d5a3e47b419f86e4eedc75491313, State: Running, Role: LEADER
I20260812 00:24:17.176398 3034 consensus_queue.cc:237] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } }
W20260812 00:24:17.179248 2695 tablet.cc:2369] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:24:17.181895 2486 catalog_manager.cc:5495] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8611d5a3e47b419f86e4eedc75491313 (127.18.163.193). New cstate: current_term: 1 leader_uuid: "8611d5a3e47b419f86e4eedc75491313" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } health_report { overall_health: UNKNOWN } } }
I20260812 00:24:17.211609 3023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:17.205725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39234 (local address 127.18.163.193:34127)
0812 00:24:17.205962 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:17.205967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:17.205987 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:24:17.206247 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:17.206251 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:17.206333 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:17.206467 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:24:17.206928 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:17.207696 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:17.209263 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:17.209763 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:17.209866 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:17.210432 (+ 566us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:24:17.210970 (+ 538us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:24:17.211137 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:17.211203 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 00:24:17.211279 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 00:24:17.220762 2802 raft_consensus.cc:1261] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9 [term 1 FOLLOWER]: Refusing update from remote peer 8611d5a3e47b419f86e4eedc75491313: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:24:17.220772 2953 raft_consensus.cc:1261] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330 [term 1 FOLLOWER]: Refusing update from remote peer 8611d5a3e47b419f86e4eedc75491313: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:24:17.221887 3040 consensus_queue.cc:1035] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:24:17.222311 3034 consensus_queue.cc:1035] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:24:17.248728 2486 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:24:17.249070 2486 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:24:17.253189 2486 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa: Sending DeleteTablet for 3 replicas of tablet c64c11e360a24a99985397243401ea4f
I20260812 00:24:17.254634 2624 tablet_service.cc:1514] Processing DeleteTablet for tablet c64c11e360a24a99985397243401ea4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:24:17 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:39232
I20260812 00:24:17.254695 2775 tablet_service.cc:1514] Processing DeleteTablet for tablet c64c11e360a24a99985397243401ea4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:24:17 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:36078
I20260812 00:24:17.254695 2930 tablet_service.cc:1514] Processing DeleteTablet for tablet c64c11e360a24a99985397243401ea4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:24:17 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:39356
I20260812 00:24:17.256346 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 2552
I20260812 00:24:17.267131 3054 tablet_replica.cc:330] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313: stopping tablet replica
I20260812 00:24:17.267863 3055 tablet_replica.cc:330] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330: stopping tablet replica
I20260812 00:24:17.268674 3055 raft_consensus.cc:2229] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:24:17.269342 3054 raft_consensus.cc:2229] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:24:17.270110 3055 raft_consensus.cc:2258] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:24:17.270933 3054 raft_consensus.cc:2258] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:24:17.274004 3055 ts_tablet_manager.cc:1905] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:24:17.275733 3054 ts_tablet_manager.cc:1905] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 00:24:17 dist-test-slave-njxd krb5kdc[2434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:24:17.290073 3056 tablet_replica.cc:330] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9: stopping tablet replica
I20260812 00:24:17.290602 3056 raft_consensus.cc:2229] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:24:17.291204 3056 raft_consensus.cc:2258] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:24:17.300203 3056 ts_tablet_manager.cc:1905] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:24:17.300926 3023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:17.257973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39248 (local address 127.18.163.193:34127)
0812 00:24:17.263474 (+ 5501us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:17.263484 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:17.273637 (+ 10153us) server_negotiation.cc:407] Connection header received
0812 00:24:17.274339 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:17.274348 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:17.274475 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:17.274607 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:17.277828 (+ 3221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:17.279516 (+ 1688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:17.282420 (+ 2904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:17.283478 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:17.283666 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:17.291749 (+ 8083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:17.291768 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:17.291788 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:17.291861 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:17.296627 (+ 4766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:17.297908 (+ 1281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:17.297920 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:17.297923 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:17.298120 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:17.298647 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:17.298653 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:17.298656 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:17.299165 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:17.299489 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:17.300166 (+ 677us) server_negotiation.cc:299] Negotiation successful
0812 00:24:17.300458 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5274}
I20260812 00:24:17.302995 2689 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:17.305538 3055 ts_tablet_manager.cc:1918] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:24:17.305872 3055 log.cc:1196] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/c64c11e360a24a99985397243401ea4f
I20260812 00:24:17.306700 3055 ts_tablet_manager.cc:1939] T c64c11e360a24a99985397243401ea4f P ba44cb7f8af944aeaf4e8c34a8677330: Deleting consensus metadata
I20260812 00:24:17.308348 3056 ts_tablet_manager.cc:1918] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:24:17.308557 3056 log.cc:1196] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/c64c11e360a24a99985397243401ea4f
I20260812 00:24:17.309105 3056 ts_tablet_manager.cc:1939] T c64c11e360a24a99985397243401ea4f P cb8052ffb89d474599cbd102f1268ea9: Deleting consensus metadata
I20260812 00:24:17.309742 2473 catalog_manager.cc:4841] TS ba44cb7f8af944aeaf4e8c34a8677330 (127.18.163.195:33545): tablet c64c11e360a24a99985397243401ea4f (table test-table [id=05066c5085294deeb4d4c328e8e98cd9]) successfully deleted
I20260812 00:24:17.312299 2473 catalog_manager.cc:4841] TS cb8052ffb89d474599cbd102f1268ea9 (127.18.163.194:43263): tablet c64c11e360a24a99985397243401ea4f (table test-table [id=05066c5085294deeb4d4c328e8e98cd9]) successfully deleted
I20260812 00:24:17.421886 3054 ts_tablet_manager.cc:1918] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:24:17.422188 3054 log.cc:1196] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/c64c11e360a24a99985397243401ea4f
I20260812 00:24:17.422751 3054 ts_tablet_manager.cc:1939] T c64c11e360a24a99985397243401ea4f P 8611d5a3e47b419f86e4eedc75491313: Deleting consensus metadata
I20260812 00:24:17.424582 2474 catalog_manager.cc:4841] TS 8611d5a3e47b419f86e4eedc75491313 (127.18.163.193:34127): tablet c64c11e360a24a99985397243401ea4f (table test-table [id=05066c5085294deeb4d4c328e8e98cd9]) successfully deleted
I20260812 00:24:17.425026 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 2552
I20260812 00:24:17.450662 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 2702
Aug 12 00:24:17 dist-test-slave-njxd krb5kdc[2434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
I20260812 00:24:17.472797 3024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:17.451573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36086 (local address 127.18.163.194:43263)
0812 00:24:17.451760 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:17.451765 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:17.451784 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:24:17.451917 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:17.451921 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:17.451988 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:17.452089 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:17.453488 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:17.454409 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:17.455840 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:17.456272 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:17.456378 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:17.466431 (+ 10053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:17.466451 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:17.466469 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:17.466522 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:17.469473 (+ 2951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:17.470411 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:17.470419 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:17.470422 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:17.470574 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:17.471009 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:17.471015 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:17.471020 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:17.471466 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:17.471824 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:17.472187 (+ 363us) server_negotiation.cc:299] Negotiation successful
0812 00:24:17.472435 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 00:24:17.473668 2847 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:17.568049 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 2702
I20260812 00:24:17.591885 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 2860
Aug 12 00:24:17 dist-test-slave-njxd krb5kdc[2434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:24:17.612191 3025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:17.592795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39358 (local address 127.18.163.195:33545)
0812 00:24:17.593002 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:17.593006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:17.593028 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:24:17.593212 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:17.593218 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:17.593294 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:17.593395 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:17.594814 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:17.595600 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:17.597063 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:17.597524 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:17.597714 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:17.605808 (+ 8094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:17.605836 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:17.605866 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:17.605924 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:17.608892 (+ 2968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:17.609885 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:17.609893 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:17.609896 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:17.610086 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:17.610583 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:17.610587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:17.610589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:17.611002 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:17.611255 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:17.611579 (+ 324us) server_negotiation.cc:299] Negotiation successful
0812 00:24:17.611772 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:24:17.612923 3001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:17.706501 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 2860
I20260812 00:24:17.730450 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 2451
I20260812 00:24:17.731722 2519 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:17.851665 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 2451
I20260812 00:24:17.880393 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:46211
--webserver_interface=127.18.163.254
--webserver_port=39733
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:46211
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:24:18.256918 3062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:18.257274 3062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:18.257373 3062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:18.265187 3062 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:24:18.265321 3062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:18.265378 3062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:18.265441 3062 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:24:18.265487 3062 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:24:18.276288 3062 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:46211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:46211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=39733
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:18.277791 3062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:18.279246 3062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:18.307929 3071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:18.307996 3068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:18.307866 3069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:18.308899 3062 server_base.cc:1034] running on GCE node
I20260812 00:24:18.310055 3062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:18.311942 3062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:18.313233 3062 hybrid_clock.cc:648] HybridClock initialized: now 1786494258313167 us; error 74 us; skew 500 ppm
I20260812 00:24:18.313759 3062 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:18 dist-test-slave-njxd krb5kdc[2434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494258, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:18.317888 3062 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:24:18.319801 3062 webserver.cc:460] Webserver started at http://127.18.163.254:39733/ using document root <none> and password file <none>
I20260812 00:24:18.320709 3062 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:18.320910 3062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:18.327713 3062 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 00:24:18.331094 3079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:18.333273 3062 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 00:24:18.333536 3062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "53a739f789534f158d19d92fb66adfaa"
format_stamp: "Formatted at 2026-08-12 00:24:14 on dist-test-slave-njxd"
server_key: "557a850bc2d10106142de43423d5db31"
server_key_iv: "3d70a9681c33502dbc0d7f25ddbf232a"
server_key_version: "encryptionkey@0"
I20260812 00:24:18.335117 3062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:18.352308 3062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:18.357800 3062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:18.358160 3062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:18.379586 3062 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:46211
I20260812 00:24:18.379562 3136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:46211 every 8 connection(s)
I20260812 00:24:18.381371 3062 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:24:18.387107 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 3062
I20260812 00:24:18.388027 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:34127
--local_ip_for_outbound_sockets=127.18.163.193
--tserver_master_addrs=127.18.163.254:46211
--webserver_port=33419
--webserver_interface=127.18.163.193
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:24:18.389497 3137 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:24:18.393406 3137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa: Bootstrap starting.
I20260812 00:24:18.421365 3137 log.cc:824] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:18.440318 3137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:24:18.441118 3137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa: Bootstrap complete.
I20260812 00:24:18.455623 3137 raft_consensus.cc:348] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } }
I20260812 00:24:18.456936 3137 raft_consensus.cc:729] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a739f789534f158d19d92fb66adfaa, State: Initialized, Role: FOLLOWER
I20260812 00:24:18.457826 3137 consensus_queue.cc:260] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } }
I20260812 00:24:18.458159 3137 raft_consensus.cc:388] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:24:18.458302 3137 raft_consensus.cc:482] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:24:18.458494 3137 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:24:18.465015 3137 raft_consensus.cc:504] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } }
I20260812 00:24:18.465816 3137 leader_election.cc:302] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 53a739f789534f158d19d92fb66adfaa; no voters:
I20260812 00:24:18.466604 3137 leader_election.cc:288] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:24:18.466817 3141 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:24:18.468091 3141 raft_consensus.cc:686] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 2 LEADER]: Becoming Leader. State: Replica: 53a739f789534f158d19d92fb66adfaa, State: Running, Role: LEADER
I20260812 00:24:18.468762 3141 consensus_queue.cc:237] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } }
I20260812 00:24:18.469024 3137 sys_catalog.cc:564] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:24:18.471627 3143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 53a739f789534f158d19d92fb66adfaa. Latest consensus state: current_term: 2 leader_uuid: "53a739f789534f158d19d92fb66adfaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } } }
I20260812 00:24:18.472092 3143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [sys.catalog]: This master's current role is: LEADER
I20260812 00:24:18.472738 3142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "53a739f789534f158d19d92fb66adfaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } } }
I20260812 00:24:18.473090 3142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [sys.catalog]: This master's current role is: LEADER
I20260812 00:24:18.483362 3149 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:24:18.492497 3149 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:24:18.494156 3149 catalog_manager.cc:1259] Loaded cluster ID: 80b95eb89bce4a8fbdcc6c7367a98bae
I20260812 00:24:18.494333 3149 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:24:18.497776 3149 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 00:24:18.517627 3149 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 00:24:18.518489 3164 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 00:24:18.527997 3149 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:24:18.529901 3149 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa: Loaded TSK: 0
I20260812 00:24:18.531589 3149 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:24:18.806661 3139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:18.807029 3139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:18.807212 3139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:18.815150 3139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:18.815344 3139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:18.815526 3139 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:24:18.826282 3139 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:34127
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=33419
--tserver_master_addrs=127.18.163.254:46211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:18.827769 3139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:18.829248 3139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:18.845428 3170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:18.845336 3171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:18.846184 3174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:18.846545 3139 server_base.cc:1034] running on GCE node
I20260812 00:24:18.847299 3139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:18.848451 3139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:18.849699 3139 hybrid_clock.cc:648] HybridClock initialized: now 1786494258849629 us; error 67 us; skew 500 ppm
I20260812 00:24:18.850036 3139 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:18 dist-test-slave-njxd krb5kdc[2434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494258, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:18.853375 3139 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:24:18.855305 3139 webserver.cc:460] Webserver started at http://127.18.163.193:33419/ using document root <none> and password file <none>
I20260812 00:24:18.856104 3139 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:18.856276 3139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:18.862550 3139 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 00:24:18.865731 3182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:18.867368 3139 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 00:24:18.867569 3139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "8611d5a3e47b419f86e4eedc75491313"
format_stamp: "Formatted at 2026-08-12 00:24:15 on dist-test-slave-njxd"
server_key: "20b920b8e53247a41fa7abb4f212e178"
server_key_iv: "bfcce5b80d18d18f011aa31fdd655c23"
server_key_version: "encryptionkey@0"
I20260812 00:24:18.868657 3139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:18.885804 3139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:18.890211 3139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:18.890540 3139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:18.891598 3139 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:24:18.893077 3139 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:24:18.893220 3139 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:18.893340 3139 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:24:18.893433 3139 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:18.929873 3139 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:34127
I20260812 00:24:18.929978 3307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:34127 every 8 connection(s)
I20260812 00:24:18.931532 3139 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:24:18.941555 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 3139
I20260812 00:24:18.942444 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:43263
--local_ip_for_outbound_sockets=127.18.163.194
--tserver_master_addrs=127.18.163.254:46211
--webserver_port=41271
--webserver_interface=127.18.163.194
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:24:18 dist-test-slave-njxd krb5kdc[2434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494258, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:24:18.959975 3311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:18.934853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:49273 (local address 127.18.163.254:46211)
0812 00:24:18.935539 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:18.935561 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:18.936271 (+ 710us) server_negotiation.cc:407] Connection header received
0812 00:24:18.938521 (+ 2250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:18.938535 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:18.938930 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:18.939247 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:18.941017 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:18.943142 (+ 2125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:18.944891 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:18.946075 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:18.946307 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:18.950404 (+ 4097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:18.950419 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:18.950445 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:18.950508 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:18.954854 (+ 4346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:18.955792 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:18.955805 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:18.955816 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:18.956071 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:18.956695 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:18.956699 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:18.956701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:18.957241 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:18.957398 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:18.958515 (+ 1117us) server_negotiation.cc:299] Negotiation successful
0812 00:24:18.958908 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":260,"threads_started":1}
I20260812 00:24:18.960425 3312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:18.935244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:49273)
0812 00:24:18.936067 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:18.936122 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:18.937949 (+ 1827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:18.939482 (+ 1533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:18.939492 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:18.940144 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:18.940710 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:18.940730 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:18.943346 (+ 2616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:18.943350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:18.944708 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:18.944724 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:18.946338 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:18.946343 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:18.946554 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:18.947318 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:18.947345 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:18.950032 (+ 2687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:18.955097 (+ 5065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:18.955105 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:18.955119 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:18.955620 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:18.956214 (+ 594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:18.956218 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:18.956220 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:18.956557 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:18.957434 (+ 877us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:18.957443 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:18.957973 (+ 530us) client_negotiation.cc:769] Sending connection context
0812 00:24:18.958330 (+ 357us) client_negotiation.cc:240] Negotiation successful
0812 00:24:18.958999 (+ 669us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":341,"threads_started":1}
I20260812 00:24:18.964389 3308 heartbeater.cc:347] Connected to a master server at 127.18.163.254:46211
I20260812 00:24:18.964856 3308 heartbeater.cc:464] Registering TS with master...
I20260812 00:24:18.965999 3308 heartbeater.cc:511] Master 127.18.163.254:46211 requested a full tablet report, sending...
I20260812 00:24:18.968618 3098 ts_manager.cc:194] Registered new tserver with Master: 8611d5a3e47b419f86e4eedc75491313 (127.18.163.193:34127)
I20260812 00:24:18.970342 3098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:49273
W20260812 00:24:19.326356 3314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:19.326735 3314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:19.326922 3314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:19.335151 3314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:19.335345 3314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:19.335549 3314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:24:19.347630 3314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:43263
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=41271
--tserver_master_addrs=127.18.163.254:46211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:19.349162 3314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:19.350708 3314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:19.366671 3320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:19.366801 3324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:19.366720 3321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:19.367328 3314 server_base.cc:1034] running on GCE node
I20260812 00:24:19.368137 3314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:19.369335 3314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:19.370604 3314 hybrid_clock.cc:648] HybridClock initialized: now 1786494259370541 us; error 56 us; skew 500 ppm
I20260812 00:24:19.370986 3314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:19 dist-test-slave-njxd krb5kdc[2434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494259, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:19.374914 3314 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:24:19.376919 3314 webserver.cc:460] Webserver started at http://127.18.163.194:41271/ using document root <none> and password file <none>
I20260812 00:24:19.377902 3314 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:19.378116 3314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:19.384634 3314 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 00:24:19.388134 3331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:19.390000 3314 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:24:19.390367 3314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "cb8052ffb89d474599cbd102f1268ea9"
format_stamp: "Formatted at 2026-08-12 00:24:16 on dist-test-slave-njxd"
server_key: "fbc3f93c46d37a41c99c7d6e27589a2c"
server_key_iv: "856481721044f5701ec4934029ef0e4b"
server_key_version: "encryptionkey@0"
I20260812 00:24:19.391520 3314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:19.407697 3314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:19.412629 3314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:19.412957 3314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:19.414172 3314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:24:19.415705 3314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:24:19.415850 3314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:19.415997 3314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:24:19.416105 3314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:19.453698 3314 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:43263
I20260812 00:24:19.453754 3458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:43263 every 8 connection(s)
I20260812 00:24:19.455425 3314 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:24:19.463428 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 3314
I20260812 00:24:19.464272 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:33545
--local_ip_for_outbound_sockets=127.18.163.195
--tserver_master_addrs=127.18.163.254:46211
--webserver_port=34391
--webserver_interface=127.18.163.195
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:24:19 dist-test-slave-njxd krb5kdc[2434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494259, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:24:19.481315 3311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:19.458349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:52437 (local address 127.18.163.254:46211)
0812 00:24:19.458569 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:19.458575 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:19.459883 (+ 1308us) server_negotiation.cc:407] Connection header received
0812 00:24:19.461851 (+ 1968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:19.461856 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:19.461949 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:19.462046 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:19.464073 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:19.464910 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:19.467720 (+ 2810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:19.468150 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:19.468268 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:19.474161 (+ 5893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:19.474168 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:19.474171 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:19.474215 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:19.477084 (+ 2869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:19.478333 (+ 1249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:19.478338 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:19.478340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:19.478502 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:19.479080 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:19.479083 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:19.479085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:19.479508 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:19.479689 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:19.480512 (+ 823us) server_negotiation.cc:299] Negotiation successful
0812 00:24:19.480822 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:24:19.482110 3461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:19.458924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:52437)
0812 00:24:19.459691 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:19.459739 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:19.461483 (+ 1744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:19.462291 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:19.462300 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:19.462911 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:19.463843 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:19.463879 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:19.465116 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:19.465126 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:19.467522 (+ 2396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:19.467544 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:19.468420 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:19.468429 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:19.468794 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:19.469729 (+ 935us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:19.469769 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:19.473837 (+ 4068us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:19.477317 (+ 3480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:19.477332 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:19.477357 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:19.478161 (+ 804us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:19.478634 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:19.478642 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:19.478648 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:19.478946 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:19.479658 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:19.479666 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:19.480047 (+ 381us) client_negotiation.cc:769] Sending connection context
0812 00:24:19.480312 (+ 265us) client_negotiation.cc:240] Negotiation successful
0812 00:24:19.480793 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":302,"threads_started":1}
I20260812 00:24:19.483855 3459 heartbeater.cc:347] Connected to a master server at 127.18.163.254:46211
I20260812 00:24:19.484258 3459 heartbeater.cc:464] Registering TS with master...
I20260812 00:24:19.485159 3459 heartbeater.cc:511] Master 127.18.163.254:46211 requested a full tablet report, sending...
I20260812 00:24:19.487020 3098 ts_manager.cc:194] Registered new tserver with Master: cb8052ffb89d474599cbd102f1268ea9 (127.18.163.194:43263)
I20260812 00:24:19.487902 3098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:52437
W20260812 00:24:19.843284 3462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:19.843668 3462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:19.843854 3462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:19.851454 3462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:19.851662 3462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:19.851877 3462 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:24:19.862486 3462 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:33545
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=34391
--tserver_master_addrs=127.18.163.254:46211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:19.864185 3462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:19.865685 3462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:19.880300 3470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:19.880383 3473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:19.880385 3467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:19.881677 3462 server_base.cc:1034] running on GCE node
I20260812 00:24:19.882406 3462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:19.883549 3462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:19.884778 3462 hybrid_clock.cc:648] HybridClock initialized: now 1786494259884722 us; error 45 us; skew 500 ppm
I20260812 00:24:19.885206 3462 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:19 dist-test-slave-njxd krb5kdc[2434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494259, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:19.889130 3462 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:24:19.890841 3462 webserver.cc:460] Webserver started at http://127.18.163.195:34391/ using document root <none> and password file <none>
I20260812 00:24:19.891601 3462 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:19.891742 3462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:19.898319 3462 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:24:19.901738 3481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:19.903406 3462 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:24:19.903630 3462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "ba44cb7f8af944aeaf4e8c34a8677330"
format_stamp: "Formatted at 2026-08-12 00:24:16 on dist-test-slave-njxd"
server_key: "279955db5d0b9207c725ad1e033d63bc"
server_key_iv: "fffd6a7f4110219ba8b7e22e10594c43"
server_key_version: "encryptionkey@0"
I20260812 00:24:19.904914 3462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:19.933151 3462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:19.938560 3462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:19.938856 3462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:19.940119 3462 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:24:19.941740 3462 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:24:19.941850 3462 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:19.941937 3462 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:24:19.941994 3462 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:19.974841 3308 heartbeater.cc:503] Master 127.18.163.254:46211 was elected leader, sending a full tablet report...
I20260812 00:24:19.978228 3462 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:33545
I20260812 00:24:19.978327 3615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:33545 every 8 connection(s)
I20260812 00:24:19.979848 3462 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:24:19.983848 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 3462
Aug 12 00:24:19 dist-test-slave-njxd krb5kdc[2434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494259, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:24:20.002694 3621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:19.985003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42786 (local address 127.18.163.254:46211)
0812 00:24:19.985622 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:19.985627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:19.985969 (+ 342us) server_negotiation.cc:407] Connection header received
0812 00:24:19.986203 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:19.986207 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:19.986277 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:19.986370 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:19.988522 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:19.989343 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:19.991020 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:19.991435 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:19.991532 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:19.995245 (+ 3713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:19.995249 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:19.995253 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:19.995288 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:19.999019 (+ 3731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:20.000039 (+ 1020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:20.000050 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:20.000052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:20.000202 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:20.000691 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:20.000694 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:20.000696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:20.001060 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:20.001380 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:20.001898 (+ 518us) server_negotiation.cc:299] Negotiation successful
0812 00:24:20.002233 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":262,"threads_started":1}
I20260812 00:24:20.006618 3619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:19.982730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:33971 (local address 127.18.163.254:46211)
0812 00:24:19.983287 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:19.983294 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:19.984456 (+ 1162us) server_negotiation.cc:407] Connection header received
0812 00:24:19.987375 (+ 2919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:19.987379 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:19.987432 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:19.987524 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:19.989537 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:19.990372 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:19.992610 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:19.993079 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:19.993177 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:19.997820 (+ 4643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:19.997826 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:19.997830 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:19.997891 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:20.001168 (+ 3277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:20.002644 (+ 1476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:20.002650 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:20.002652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:20.002901 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:20.003685 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:20.003692 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:20.003695 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:20.004164 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:20.004320 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:20.005704 (+ 1384us) server_negotiation.cc:299] Negotiation successful
0812 00:24:20.006075 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":273,"threads_started":1}
I20260812 00:24:20.007929 3620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:19.983288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:33971)
0812 00:24:19.984223 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:19.984315 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:19.987032 (+ 2717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:19.987880 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:19.987895 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:19.988690 (+ 795us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:19.989325 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:19.989343 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:19.990555 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:19.990561 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:19.992419 (+ 1858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:19.992441 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:19.993348 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:19.993357 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:19.993761 (+ 404us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:19.994503 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:19.994554 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:19.997465 (+ 2911us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:20.001398 (+ 3933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:20.001413 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:20.001449 (+ 36us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:20.002459 (+ 1010us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:20.003088 (+ 629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:20.003095 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:20.003099 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:20.003526 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:20.004368 (+ 842us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:20.004383 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:20.005128 (+ 745us) client_negotiation.cc:769] Sending connection context
0812 00:24:20.005481 (+ 353us) client_negotiation.cc:240] Negotiation successful
0812 00:24:20.006267 (+ 786us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":333,"threads_started":1}
I20260812 00:24:20.010247 3616 heartbeater.cc:347] Connected to a master server at 127.18.163.254:46211
I20260812 00:24:20.010677 3616 heartbeater.cc:464] Registering TS with master...
I20260812 00:24:20.011547 3616 heartbeater.cc:511] Master 127.18.163.254:46211 requested a full tablet report, sending...
I20260812 00:24:20.013298 3098 ts_manager.cc:194] Registered new tserver with Master: ba44cb7f8af944aeaf4e8c34a8677330 (127.18.163.195:33545)
I20260812 00:24:20.014295 3098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:33971
I20260812 00:24:20.019731 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:24:20.027305 3619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:20.020685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42796 (local address 127.18.163.254:46211)
0812 00:24:20.020927 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:20.020936 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:20.021423 (+ 487us) server_negotiation.cc:407] Connection header received
0812 00:24:20.021720 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:20.021724 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:20.021890 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:20.022032 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:24:20.022487 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.023214 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.024826 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.025303 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.025411 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:20.026062 (+ 651us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:24:20.026670 (+ 608us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:24:20.026787 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:20.026898 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 00:24:20.026980 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:24:20.028388 3098 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:42796:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:24:20.036298 3098 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:24:20.075394 3630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:20.049483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:33545 (local address 127.0.0.1:39366)
0812 00:24:20.064977 (+ 15494us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:20.065032 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:20.065246 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:20.066316 (+ 1070us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:20.066325 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:20.066360 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:20.067014 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:20.067028 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.069304 (+ 2276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.069310 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:20.071956 (+ 2646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:20.071969 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.074186 (+ 2217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.074192 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:20.074430 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:20.074508 (+ 78us) client_negotiation.cc:769] Sending connection context
0812 00:24:20.074668 (+ 160us) client_negotiation.cc:240] Negotiation successful
0812 00:24:20.074884 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15217,"mutex_wait_us":1,"thread_start_us":15996,"threads_started":1}
I20260812 00:24:20.076232 3628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:20.049932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:34127 (local address 127.0.0.1:39254)
0812 00:24:20.065816 (+ 15884us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:20.065832 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:20.065994 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:20.068412 (+ 2418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:20.068419 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:20.068449 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:20.068795 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:20.068804 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.070731 (+ 1927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.070743 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:20.072689 (+ 1946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:20.072712 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.075362 (+ 2650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.075369 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:20.075549 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:20.075584 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 00:24:20.075685 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 00:24:20.075833 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15747,"mutex_wait_us":1,"thread_start_us":14590,"threads_started":1}
I20260812 00:24:20.076416 3629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:20.049739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39366 (local address 127.18.163.195:33545)
0812 00:24:20.065520 (+ 15781us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:20.065530 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:20.065594 (+ 64us) server_negotiation.cc:407] Connection header received
0812 00:24:20.065725 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:20.065734 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:20.066036 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:20.066273 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:20.067298 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.069068 (+ 1770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.072156 (+ 3088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.073552 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.075565 (+ 2013us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:20.075766 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:20.075842 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 00:24:20.076032 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15518,"thread_start_us":15735,"threads_started":1}
I20260812 00:24:20.076534 3631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:20.050255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39254 (local address 127.18.163.193:34127)
0812 00:24:20.063935 (+ 13680us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:20.063952 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:20.065971 (+ 2019us) server_negotiation.cc:407] Connection header received
0812 00:24:20.067377 (+ 1406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:20.067388 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:20.067717 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:20.067986 (+ 269us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:20.069000 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.070562 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.072888 (+ 2326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.074701 (+ 1813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.074923 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:20.075156 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:20.075994 (+ 838us) server_negotiation.cc:299] Negotiation successful
0812 00:24:20.076171 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13366,"thread_start_us":13713,"threads_started":1}
I20260812 00:24:20.077921 3632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:20.066324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:43263 (local address 127.0.0.1:36094)
0812 00:24:20.067087 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:20.067104 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:20.067243 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:20.069059 (+ 1816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:20.069064 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:20.069091 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:20.069683 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:20.069699 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.071658 (+ 1959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.071664 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:20.073824 (+ 2160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:20.073843 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.077007 (+ 3164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.077015 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:20.077193 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:20.077233 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 00:24:20.077343 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 00:24:20.077483 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"mutex_wait_us":52,"thread_start_us":450,"threads_started":1}
I20260812 00:24:20.078516 3633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:20.066363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36094 (local address 127.18.163.194:43263)
0812 00:24:20.068474 (+ 2111us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:20.068486 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:20.068519 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:24:20.068609 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:20.068617 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:20.068838 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:20.069400 (+ 562us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:20.069908 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.071494 (+ 1586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.074010 (+ 2516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.076245 (+ 2235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.076971 (+ 726us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:20.077145 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:20.077391 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 00:24:20.077561 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1950,"thread_start_us":2005,"threads_started":1}
I20260812 00:24:20.080502 3233 tablet_service.cc:1467] Processing CreateTablet for tablet 717fd404eea0455b8205afc0a48bdcc7 (DEFAULT_TABLE table=test-table [id=da15fc7dbfb34d4794b5d5d0a69f18da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:24:20.080547 3536 tablet_service.cc:1467] Processing CreateTablet for tablet 717fd404eea0455b8205afc0a48bdcc7 (DEFAULT_TABLE table=test-table [id=da15fc7dbfb34d4794b5d5d0a69f18da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:24:20.082163 3233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 717fd404eea0455b8205afc0a48bdcc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:20.082634 3536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 717fd404eea0455b8205afc0a48bdcc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:20.082351 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 717fd404eea0455b8205afc0a48bdcc7 (DEFAULT_TABLE table=test-table [id=da15fc7dbfb34d4794b5d5d0a69f18da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:24:20.083853 3384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 717fd404eea0455b8205afc0a48bdcc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:20.095930 3634 tablet_bootstrap.cc:492] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313: Bootstrap starting.
I20260812 00:24:20.099622 3634 tablet_bootstrap.cc:654] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313: Neither blocks nor log segments found. Creating new log.
I20260812 00:24:20.101018 3636 tablet_bootstrap.cc:492] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9: Bootstrap starting.
I20260812 00:24:20.102499 3637 tablet_bootstrap.cc:492] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330: Bootstrap starting.
I20260812 00:24:20.103679 3634 log.cc:824] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:20.105481 3636 tablet_bootstrap.cc:654] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9: Neither blocks nor log segments found. Creating new log.
I20260812 00:24:20.106082 3637 tablet_bootstrap.cc:654] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330: Neither blocks nor log segments found. Creating new log.
I20260812 00:24:20.106936 3636 log.cc:824] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:20.107144 3637 log.cc:824] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:20.107700 3634 tablet_bootstrap.cc:492] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313: No bootstrap required, opened a new log
I20260812 00:24:20.108052 3634 ts_tablet_manager.cc:1397] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260812 00:24:20.110848 3636 tablet_bootstrap.cc:492] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9: No bootstrap required, opened a new log
I20260812 00:24:20.111186 3636 ts_tablet_manager.cc:1397] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.005s
I20260812 00:24:20.111634 3637 tablet_bootstrap.cc:492] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330: No bootstrap required, opened a new log
I20260812 00:24:20.111913 3637 ts_tablet_manager.cc:1397] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260812 00:24:20.121016 3637 raft_consensus.cc:348] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } }
I20260812 00:24:20.120944 3634 raft_consensus.cc:348] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } }
I20260812 00:24:20.121506 3637 raft_consensus.cc:374] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:20.121516 3634 raft_consensus.cc:374] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:20.121641 3637 raft_consensus.cc:729] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba44cb7f8af944aeaf4e8c34a8677330, State: Initialized, Role: FOLLOWER
I20260812 00:24:20.121655 3634 raft_consensus.cc:729] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8611d5a3e47b419f86e4eedc75491313, State: Initialized, Role: FOLLOWER
I20260812 00:24:20.122442 3637 consensus_queue.cc:260] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } }
I20260812 00:24:20.122463 3634 consensus_queue.cc:260] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } }
I20260812 00:24:20.123200 3636 raft_consensus.cc:348] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } }
I20260812 00:24:20.123768 3616 heartbeater.cc:503] Master 127.18.163.254:46211 was elected leader, sending a full tablet report...
I20260812 00:24:20.123857 3636 raft_consensus.cc:374] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:20.123973 3636 raft_consensus.cc:729] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb8052ffb89d474599cbd102f1268ea9, State: Initialized, Role: FOLLOWER
I20260812 00:24:20.124585 3637 ts_tablet_manager.cc:1428] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330: Time spent starting tablet: real 0.013s user 0.008s sys 0.005s
I20260812 00:24:20.124979 3636 consensus_queue.cc:260] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } }
I20260812 00:24:20.127560 3634 ts_tablet_manager.cc:1428] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313: Time spent starting tablet: real 0.019s user 0.016s sys 0.001s
I20260812 00:24:20.128605 3459 heartbeater.cc:503] Master 127.18.163.254:46211 was elected leader, sending a full tablet report...
I20260812 00:24:20.129384 3636 ts_tablet_manager.cc:1428] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9: Time spent starting tablet: real 0.018s user 0.015s sys 0.003s
W20260812 00:24:20.184325 3309 tablet.cc:2369] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:24:20.207753 3460 tablet.cc:2369] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:24:20.231758 3618 tablet.cc:2369] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:24:20.465466 3642 raft_consensus.cc:482] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:24:20.465894 3642 raft_consensus.cc:504] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } }
I20260812 00:24:20.467849 3642 leader_election.cc:288] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba44cb7f8af944aeaf4e8c34a8677330 (127.18.163.195:33545), cb8052ffb89d474599cbd102f1268ea9 (127.18.163.194:43263)
I20260812 00:24:20.475735 3629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:20.468312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:53565 (local address 127.18.163.195:33545)
0812 00:24:20.468525 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:20.468530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:20.469237 (+ 707us) server_negotiation.cc:407] Connection header received
0812 00:24:20.469565 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:20.469596 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:20.469726 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:20.469838 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:20.470649 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.471357 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.473639 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.474713 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.474893 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:20.474977 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:20.475294 (+ 317us) server_negotiation.cc:299] Negotiation successful
0812 00:24:20.475447 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 00:24:20.475736 3644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:20.468312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:33545 (local address 127.18.163.193:53565)
0812 00:24:20.469077 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:20.469095 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:20.469315 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:20.469968 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:20.469979 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:20.470006 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:20.470481 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:20.470499 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.471493 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.471498 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:20.473429 (+ 1931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:20.473443 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.474963 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.474968 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:20.475101 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:20.475129 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 00:24:20.475235 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 00:24:20.475344 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":393,"threads_started":1}
I20260812 00:24:20.476789 3645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:20.469289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:43263 (local address 127.18.163.193:51517)
0812 00:24:20.470033 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:20.470049 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:20.470230 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:20.470662 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:20.470667 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:20.470695 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:20.470989 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:20.470997 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.472401 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.472406 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:20.474092 (+ 1686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:20.474106 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.475757 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.475766 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:20.476201 (+ 435us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:20.476239 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:24:20.476334 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 00:24:20.476483 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":369,"threads_started":1}
I20260812 00:24:20.476812 3633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:20.469658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:51517 (local address 127.18.163.194:43263)
0812 00:24:20.469898 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:20.469906 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:20.470166 (+ 260us) server_negotiation.cc:407] Connection header received
0812 00:24:20.470355 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:20.470360 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:20.470445 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:20.470563 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:20.471167 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.472239 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.474275 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.475470 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.475640 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:20.475710 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:20.476393 (+ 683us) server_negotiation.cc:299] Negotiation successful
0812 00:24:20.476546 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260812 00:24:20.476971 3556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "717fd404eea0455b8205afc0a48bdcc7" candidate_uuid: "8611d5a3e47b419f86e4eedc75491313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" is_pre_election: true
I20260812 00:24:20.477677 3556 raft_consensus.cc:2454] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8611d5a3e47b419f86e4eedc75491313 in term 0.
I20260812 00:24:20.477994 3408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "717fd404eea0455b8205afc0a48bdcc7" candidate_uuid: "8611d5a3e47b419f86e4eedc75491313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb8052ffb89d474599cbd102f1268ea9" is_pre_election: true
I20260812 00:24:20.478406 3185 leader_election.cc:302] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8611d5a3e47b419f86e4eedc75491313, ba44cb7f8af944aeaf4e8c34a8677330; no voters:
I20260812 00:24:20.478623 3408 raft_consensus.cc:2454] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8611d5a3e47b419f86e4eedc75491313 in term 0.
I20260812 00:24:20.478853 3642 raft_consensus.cc:2781] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:24:20.479013 3642 raft_consensus.cc:482] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:24:20.479138 3642 raft_consensus.cc:3037] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:20.481539 3642 raft_consensus.cc:504] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } }
I20260812 00:24:20.482309 3642 leader_election.cc:288] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [CANDIDATE]: Term 1 election: Requested vote from peers ba44cb7f8af944aeaf4e8c34a8677330 (127.18.163.195:33545), cb8052ffb89d474599cbd102f1268ea9 (127.18.163.194:43263)
I20260812 00:24:20.483021 3556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "717fd404eea0455b8205afc0a48bdcc7" candidate_uuid: "8611d5a3e47b419f86e4eedc75491313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba44cb7f8af944aeaf4e8c34a8677330"
I20260812 00:24:20.483088 3408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "717fd404eea0455b8205afc0a48bdcc7" candidate_uuid: "8611d5a3e47b419f86e4eedc75491313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb8052ffb89d474599cbd102f1268ea9"
I20260812 00:24:20.483259 3556 raft_consensus.cc:3037] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:20.483371 3408 raft_consensus.cc:3037] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:20.486023 3556 raft_consensus.cc:2454] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8611d5a3e47b419f86e4eedc75491313 in term 1.
I20260812 00:24:20.486028 3408 raft_consensus.cc:2454] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8611d5a3e47b419f86e4eedc75491313 in term 1.
I20260812 00:24:20.486622 3185 leader_election.cc:302] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8611d5a3e47b419f86e4eedc75491313, ba44cb7f8af944aeaf4e8c34a8677330; no voters:
I20260812 00:24:20.487000 3642 raft_consensus.cc:2781] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:24:20.487464 3642 raft_consensus.cc:686] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [term 1 LEADER]: Becoming Leader. State: Replica: 8611d5a3e47b419f86e4eedc75491313, State: Running, Role: LEADER
I20260812 00:24:20.488044 3642 consensus_queue.cc:237] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } } peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } }
I20260812 00:24:20.493351 3096 catalog_manager.cc:5495] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8611d5a3e47b419f86e4eedc75491313 (127.18.163.193). New cstate: current_term: 1 leader_uuid: "8611d5a3e47b419f86e4eedc75491313" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8611d5a3e47b419f86e4eedc75491313" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260812 00:24:20.521410 3631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:20.515299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39260 (local address 127.18.163.193:34127)
0812 00:24:20.515541 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:20.515548 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:20.515616 (+ 68us) server_negotiation.cc:407] Connection header received
0812 00:24:20.515887 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:20.515891 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:20.515978 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:20.516158 (+ 180us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:24:20.516585 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.517360 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.518968 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.519422 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.519570 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:20.520145 (+ 575us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:24:20.520762 (+ 617us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:24:20.520942 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:20.521025 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 00:24:20.521124 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 00:24:20.530846 3408 raft_consensus.cc:1261] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9 [term 1 FOLLOWER]: Refusing update from remote peer 8611d5a3e47b419f86e4eedc75491313: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:24:20.530853 3556 raft_consensus.cc:1261] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330 [term 1 FOLLOWER]: Refusing update from remote peer 8611d5a3e47b419f86e4eedc75491313: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:24:20.532079 3646 consensus_queue.cc:1035] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb8052ffb89d474599cbd102f1268ea9" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 43263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:24:20.532557 3642 consensus_queue.cc:1035] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba44cb7f8af944aeaf4e8c34a8677330" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:24:20.544005 3648 mvcc.cc:205] Tried to move back new op lower bound from 7317480491121479680 to 7317480490962984960. Current Snapshot: MvccSnapshot[applied={T|T < 7317480491121479680}]
I20260812 00:24:20.547068 3650 mvcc.cc:205] Tried to move back new op lower bound from 7317480491121479680 to 7317480490962984960. Current Snapshot: MvccSnapshot[applied={T|T < 7317480491121479680}]
I20260812 00:24:20.560205 3096 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:42796:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:24:20.560536 3096 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:42796:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:24:20.564093 3096 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa: Sending DeleteTablet for 3 replicas of tablet 717fd404eea0455b8205afc0a48bdcc7
I20260812 00:24:20.565549 3384 tablet_service.cc:1514] Processing DeleteTablet for tablet 717fd404eea0455b8205afc0a48bdcc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:24:20 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:36094
I20260812 00:24:20.565549 3536 tablet_service.cc:1514] Processing DeleteTablet for tablet 717fd404eea0455b8205afc0a48bdcc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:24:20 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:39366
I20260812 00:24:20.566820 3233 tablet_service.cc:1514] Processing DeleteTablet for tablet 717fd404eea0455b8205afc0a48bdcc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:24:20 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:39254
I20260812 00:24:20.567049 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 3139
I20260812 00:24:20.578372 3661 tablet_replica.cc:330] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313: stopping tablet replica
I20260812 00:24:20.579128 3661 raft_consensus.cc:2229] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:24:20.580065 3661 raft_consensus.cc:2258] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:24:20.582738 3661 ts_tablet_manager.cc:1905] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:24:20.591578 3661 ts_tablet_manager.cc:1918] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:24:20.591935 3661 log.cc:1196] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/717fd404eea0455b8205afc0a48bdcc7
I20260812 00:24:20.592896 3661 ts_tablet_manager.cc:1939] T 717fd404eea0455b8205afc0a48bdcc7 P 8611d5a3e47b419f86e4eedc75491313: Deleting consensus metadata
I20260812 00:24:20.594261 3659 tablet_replica.cc:330] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330: stopping tablet replica
I20260812 00:24:20.594988 3660 tablet_replica.cc:330] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9: stopping tablet replica
I20260812 00:24:20.595153 3083 catalog_manager.cc:4841] TS 8611d5a3e47b419f86e4eedc75491313 (127.18.163.193:34127): tablet 717fd404eea0455b8205afc0a48bdcc7 (table test-table [id=da15fc7dbfb34d4794b5d5d0a69f18da]) successfully deleted
I20260812 00:24:20.595629 3660 raft_consensus.cc:2229] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:24:20.595780 3659 raft_consensus.cc:2229] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:24:20.596220 3660 raft_consensus.cc:2258] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:24:20.596220 3659 raft_consensus.cc:2258] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:24:20.598773 3659 ts_tablet_manager.cc:1905] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:24:20.598773 3660 ts_tablet_manager.cc:1905] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:24:20.606280 3659 ts_tablet_manager.cc:1918] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:24:20.606280 3660 ts_tablet_manager.cc:1918] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:24:20.606472 3660 log.cc:1196] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/717fd404eea0455b8205afc0a48bdcc7
I20260812 00:24:20.606472 3659 log.cc:1196] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/717fd404eea0455b8205afc0a48bdcc7
I20260812 00:24:20.607064 3659 ts_tablet_manager.cc:1939] T 717fd404eea0455b8205afc0a48bdcc7 P ba44cb7f8af944aeaf4e8c34a8677330: Deleting consensus metadata
I20260812 00:24:20.607061 3660 ts_tablet_manager.cc:1939] T 717fd404eea0455b8205afc0a48bdcc7 P cb8052ffb89d474599cbd102f1268ea9: Deleting consensus metadata
I20260812 00:24:20.609208 3082 catalog_manager.cc:4841] TS cb8052ffb89d474599cbd102f1268ea9 (127.18.163.194:43263): tablet 717fd404eea0455b8205afc0a48bdcc7 (table test-table [id=da15fc7dbfb34d4794b5d5d0a69f18da]) successfully deleted
I20260812 00:24:20.609545 3082 catalog_manager.cc:4841] TS ba44cb7f8af944aeaf4e8c34a8677330 (127.18.163.195:33545): tablet 717fd404eea0455b8205afc0a48bdcc7 (table test-table [id=da15fc7dbfb34d4794b5d5d0a69f18da]) successfully deleted
I20260812 00:24:20.613263 3631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:20.568118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39266 (local address 127.18.163.193:34127)
0812 00:24:20.568311 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:20.568317 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:20.590853 (+ 22536us) server_negotiation.cc:407] Connection header received
0812 00:24:20.591134 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:20.591141 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:20.591258 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:20.591412 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:20.595551 (+ 4139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.597193 (+ 1642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.599600 (+ 2407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.600333 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.600472 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:20.604601 (+ 4129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:20.604623 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:20.604658 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:20.604719 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:20.609422 (+ 4703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:20.610606 (+ 1184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:20.610618 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:20.610623 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:20.610886 (+ 263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:20.611323 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:20.611328 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:20.611332 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:20.611872 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:20.612210 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:20.612492 (+ 282us) server_negotiation.cc:299] Negotiation successful
0812 00:24:20.612779 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 00:24:20.614152 3303 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:20.718824 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 3139
I20260812 00:24:20.745103 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 3314
I20260812 00:24:20.759600 3633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:20.746036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36104 (local address 127.18.163.194:43263)
0812 00:24:20.746225 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:20.746230 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:20.746249 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:24:20.746424 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:20.746428 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:20.746496 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:20.746588 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:20.748065 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.748818 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.750340 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.750774 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.750891 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:20.753787 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:20.753805 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:20.753822 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:20.753865 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:20.756725 (+ 2860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:20.757510 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:20.757517 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:20.757519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:20.757768 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:20.758157 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:20.758160 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:20.758162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:20.758566 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:20.758805 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:20.759129 (+ 324us) server_negotiation.cc:299] Negotiation successful
0812 00:24:20.759323 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 00:24:20.760409 3453 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:20.854585 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 3314
I20260812 00:24:20.878630 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 3462
I20260812 00:24:20.893401 3629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:20.879485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39376 (local address 127.18.163.195:33545)
0812 00:24:20.879685 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:20.879689 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:20.879712 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:24:20.879922 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:20.879926 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:20.880009 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:20.880111 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:20.881510 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.882404 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.883850 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:20.884277 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:20.884392 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:20.887387 (+ 2995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:20.887406 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:20.887423 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:20.887463 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:20.890414 (+ 2951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:20.891226 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:20.891234 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:20.891236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:20.891396 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:20.891750 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:20.891753 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:20.891755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:20.892140 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:20.892384 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:20.892688 (+ 304us) server_negotiation.cc:299] Negotiation successful
0812 00:24:20.892888 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 00:24:20.894274 3610 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:20.987103 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 3462
I20260812 00:24:21.010970 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 3062
I20260812 00:24:21.012269 3132 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:21.134932 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 3062
I20260812 00:24:21.165304 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:46211
--webserver_interface=127.18.163.254
--webserver_port=39733
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:46211
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:24:21.542660 3668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:21.543001 3668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:21.543186 3668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:21.551085 3668 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:24:21.551226 3668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:21.551338 3668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:21.551440 3668 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:24:21.551522 3668 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:24:21.562420 3668 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:46211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:46211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=39733
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:21.563937 3668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:21.565423 3668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:21.577975 3673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:21.578008 3676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:21.578050 3674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:21.579998 3668 server_base.cc:1034] running on GCE node
I20260812 00:24:21.580839 3668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:21.582455 3668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:21.583673 3668 hybrid_clock.cc:648] HybridClock initialized: now 1786494261583624 us; error 36 us; skew 500 ppm
I20260812 00:24:21.584064 3668 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:21 dist-test-slave-njxd krb5kdc[2434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494261, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:21.587463 3668 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:24:21.589125 3668 webserver.cc:460] Webserver started at http://127.18.163.254:39733/ using document root <none> and password file <none>
I20260812 00:24:21.589942 3668 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:21.590057 3668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:21.595964 3668 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 00:24:21.599128 3685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:21.600724 3668 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:24:21.600871 3668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "53a739f789534f158d19d92fb66adfaa"
format_stamp: "Formatted at 2026-08-12 00:24:14 on dist-test-slave-njxd"
server_key: "557a850bc2d10106142de43423d5db31"
server_key_iv: "3d70a9681c33502dbc0d7f25ddbf232a"
server_key_version: "encryptionkey@0"
I20260812 00:24:21.602007 3668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:21.617508 3668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:21.622151 3668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:21.622406 3668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:21.642736 3668 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:46211
I20260812 00:24:21.642755 3742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:46211 every 8 connection(s)
I20260812 00:24:21.644775 3668 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:24:21.652073 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 3668
I20260812 00:24:21.652998 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:34127
--local_ip_for_outbound_sockets=127.18.163.193
--tserver_master_addrs=127.18.163.254:46211
--webserver_port=33419
--webserver_interface=127.18.163.193
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:24:21.654791 3743 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:24:21.658607 3743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa: Bootstrap starting.
I20260812 00:24:21.684201 3743 log.cc:824] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:21.708309 3743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:24:21.709024 3743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa: Bootstrap complete.
I20260812 00:24:21.722756 3743 raft_consensus.cc:348] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } }
I20260812 00:24:21.724227 3743 raft_consensus.cc:729] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a739f789534f158d19d92fb66adfaa, State: Initialized, Role: FOLLOWER
I20260812 00:24:21.725041 3743 consensus_queue.cc:260] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } }
I20260812 00:24:21.725361 3743 raft_consensus.cc:388] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:24:21.725498 3743 raft_consensus.cc:482] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:24:21.725715 3743 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 2 FOLLOWER]: Advancing to term 3
I20260812 00:24:21.731870 3743 raft_consensus.cc:504] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } }
I20260812 00:24:21.732523 3743 leader_election.cc:302] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 53a739f789534f158d19d92fb66adfaa; no voters:
I20260812 00:24:21.733273 3743 leader_election.cc:288] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 00:24:21.733428 3747 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 3 FOLLOWER]: Leader election won for term 3
I20260812 00:24:21.734941 3747 raft_consensus.cc:686] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [term 3 LEADER]: Becoming Leader. State: Replica: 53a739f789534f158d19d92fb66adfaa, State: Running, Role: LEADER
I20260812 00:24:21.735585 3747 consensus_queue.cc:237] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } }
I20260812 00:24:21.735924 3743 sys_catalog.cc:564] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:24:21.738838 3748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "53a739f789534f158d19d92fb66adfaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } } }
I20260812 00:24:21.739313 3748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [sys.catalog]: This master's current role is: LEADER
I20260812 00:24:21.738862 3749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 53a739f789534f158d19d92fb66adfaa. Latest consensus state: current_term: 3 leader_uuid: "53a739f789534f158d19d92fb66adfaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53a739f789534f158d19d92fb66adfaa" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46211 } } }
I20260812 00:24:21.739765 3749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53a739f789534f158d19d92fb66adfaa [sys.catalog]: This master's current role is: LEADER
I20260812 00:24:21.751297 3752 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:24:21.760324 3752 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:24:21.762022 3752 catalog_manager.cc:1259] Loaded cluster ID: 80b95eb89bce4a8fbdcc6c7367a98bae
I20260812 00:24:21.762151 3752 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 00:24:21.764463 3752 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fb2b94429ad google::LogMessage::Fail() at ??:0
@ 0x7fb2b944588a google::LogMessage::SendToLog() at ??:0
@ 0x7fb2b94424de google::LogMessage::Flush() at ??:0
@ 0x7fb2b9443a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fb2cee79512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fb2cee76976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fb2ceefe610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fb2ceefe439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fb2bc08e345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fb2bc09191c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fb2bc091799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fb2bc06ceaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fb2bf3466db start_thread at ??:0
@ 0x7fb2b82dc61f clone at ??:0
W20260812 00:24:22.143657 3745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:22.143987 3745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:22.144104 3745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:22.151686 3745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:22.151820 3745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:22.151937 3745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:24:22.162415 3745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:34127
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=33419
--tserver_master_addrs=127.18.163.254:46211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:22.163836 3745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:22.165217 3745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:22.179787 3791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:22.179847 3793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:22.179904 3789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:22.180810 3745 server_base.cc:1034] running on GCE node
I20260812 00:24:22.181457 3745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:22.182566 3745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:22.183785 3745 hybrid_clock.cc:648] HybridClock initialized: now 1786494262183741 us; error 32 us; skew 500 ppm
I20260812 00:24:22.184093 3745 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:22 dist-test-slave-njxd krb5kdc[2434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494262, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:22.187752 3745 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:24:22.189683 3745 webserver.cc:460] Webserver started at http://127.18.163.193:33419/ using document root <none> and password file <none>
I20260812 00:24:22.190512 3745 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:22.190690 3745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:22.196900 3745 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 00:24:22.200526 3801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:22.202333 3745 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:24:22.202535 3745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "8611d5a3e47b419f86e4eedc75491313"
format_stamp: "Formatted at 2026-08-12 00:24:15 on dist-test-slave-njxd"
server_key: "20b920b8e53247a41fa7abb4f212e178"
server_key_iv: "bfcce5b80d18d18f011aa31fdd655c23"
server_key_version: "encryptionkey@0"
I20260812 00:24:22.203642 3745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:22.223377 3745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:22.228876 3745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:22.229211 3745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:22.230384 3745 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:24:22.231869 3745 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:24:22.232012 3745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:22.232156 3745 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:24:22.232255 3745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:22.268419 3745 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:34127
I20260812 00:24:22.268483 3927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:34127 every 8 connection(s)
I20260812 00:24:22.270126 3745 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:24:22.275555 3930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:22.273534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:49225)
0812 00:24:22.274368 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:22.274615 (+ 247us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":314,"threads_started":1}
W20260812 00:24:22.276363 3928 heartbeater.cc:644] Failed to heartbeat to 127.18.163.254:46211 (0 consecutive failures): Network error: Failed to ping master at 127.18.163.254:46211: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
I20260812 00:24:22.277319 3930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:22.276946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:42657)
0812 00:24:22.277116 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:22.277194 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 00:24:22.277559 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 3745
I20260812 00:24:22.278278 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:43263
--local_ip_for_outbound_sockets=127.18.163.194
--tserver_master_addrs=127.18.163.254:46211
--webserver_port=41271
--webserver_interface=127.18.163.194
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:24:22.278425 3930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:22.278002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:41467)
0812 00:24:22.278193 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:22.278283 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260812 00:24:22.278618 3928 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:24:22.650193 3931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:22.650575 3931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:22.650763 3931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:22.658394 3931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:22.658533 3931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:22.658663 3931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:24:22.668982 3931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:43263
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=41271
--tserver_master_addrs=127.18.163.254:46211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:22.670409 3931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:22.671955 3931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:22.686533 3936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:22.686581 3937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:22.686633 3939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:22.687564 3931 server_base.cc:1034] running on GCE node
I20260812 00:24:22.688292 3931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:22.689342 3931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:22.690635 3931 hybrid_clock.cc:648] HybridClock initialized: now 1786494262690561 us; error 58 us; skew 500 ppm
I20260812 00:24:22.691010 3931 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:22 dist-test-slave-njxd krb5kdc[2434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494262, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:22.699900 3931 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:24:22.701835 3931 webserver.cc:460] Webserver started at http://127.18.163.194:41271/ using document root <none> and password file <none>
I20260812 00:24:22.702653 3931 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:22.702818 3931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:22.709182 3931 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.003s
I20260812 00:24:22.712386 3947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:22.714129 3931 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 00:24:22.714345 3931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "cb8052ffb89d474599cbd102f1268ea9"
format_stamp: "Formatted at 2026-08-12 00:24:16 on dist-test-slave-njxd"
server_key: "fbc3f93c46d37a41c99c7d6e27589a2c"
server_key_iv: "856481721044f5701ec4934029ef0e4b"
server_key_version: "encryptionkey@0"
I20260812 00:24:22.715490 3931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:22.734067 3931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:22.739075 3931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:22.739415 3931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:22.740545 3931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:24:22.742238 3931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:24:22.742393 3931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:22.742532 3931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:24:22.742631 3931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:22.784499 3931 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:43263
I20260812 00:24:22.784574 4071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:43263 every 8 connection(s)
I20260812 00:24:22.786185 3931 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:24:22.791276 4077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:22.789319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:46163)
0812 00:24:22.790109 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:22.790380 (+ 271us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":341,"threads_started":1}
W20260812 00:24:22.791993 4072 heartbeater.cc:644] Failed to heartbeat to 127.18.163.254:46211 (0 consecutive failures): Network error: Failed to ping master at 127.18.163.254:46211: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
I20260812 00:24:22.792814 4077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:22.792477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:33535)
0812 00:24:22.792629 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:22.792704 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 00:24:22.793766 4077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:22.793343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:59991)
0812 00:24:22.793468 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:22.793544 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 00:24:22.794085 4072 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:24:22.794242 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 3931
I20260812 00:24:22.794898 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:33545
--local_ip_for_outbound_sockets=127.18.163.195
--tserver_master_addrs=127.18.163.254:46211
--webserver_port=34391
--webserver_interface=127.18.163.195
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:24:23.163408 4078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:23.163746 4078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:23.163851 4078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:23.171547 4078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:23.171693 4078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:23.171909 4078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:24:23.182245 4078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:33545
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=34391
--tserver_master_addrs=127.18.163.254:46211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:23.183708 4078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:23.185189 4078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:23.199739 4084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:23.199781 4083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:23.200354 4086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:23.206144 4078 server_base.cc:1034] running on GCE node
I20260812 00:24:23.206892 4078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:23.208102 4078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:23.209395 4078 hybrid_clock.cc:648] HybridClock initialized: now 1786494263209345 us; error 45 us; skew 500 ppm
I20260812 00:24:23.209852 4078 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:23 dist-test-slave-njxd krb5kdc[2434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494263, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:23.213536 4078 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:24:23.215539 4078 webserver.cc:460] Webserver started at http://127.18.163.195:34391/ using document root <none> and password file <none>
I20260812 00:24:23.216388 4078 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:23.216578 4078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:23.223371 4078 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.004s
I20260812 00:24:23.226992 4094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:23.228694 4078 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 00:24:23.228943 4078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "ba44cb7f8af944aeaf4e8c34a8677330"
format_stamp: "Formatted at 2026-08-12 00:24:16 on dist-test-slave-njxd"
server_key: "279955db5d0b9207c725ad1e033d63bc"
server_key_iv: "fffd6a7f4110219ba8b7e22e10594c43"
server_key_version: "encryptionkey@0"
I20260812 00:24:23.230274 4078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:23.260695 4078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:23.266029 4078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:23.266374 4078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:23.267553 4078 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:24:23.269174 4078 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:24:23.269315 4078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:23.269464 4078 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:24:23.269562 4078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:23.280424 4137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:23.279434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:41899)
0812 00:24:23.280023 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:23.280178 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":297,"threads_started":1}
I20260812 00:24:23.307507 4078 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:33545
I20260812 00:24:23.307617 4230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:33545 every 8 connection(s)
I20260812 00:24:23.309207 4078 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:24:23.311151 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 4078
I20260812 00:24:23.314926 4234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:23.312728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:45491)
0812 00:24:23.313680 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:23.313948 (+ 268us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":398,"threads_started":1}
W20260812 00:24:23.315694 4231 heartbeater.cc:644] Failed to heartbeat to 127.18.163.254:46211 (0 consecutive failures): Network error: Failed to ping master at 127.18.163.254:46211: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
I20260812 00:24:23.316646 4234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:23.316269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:47021)
0812 00:24:23.316433 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:23.316512 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 00:24:23.317519 4234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:23.317171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:38263)
0812 00:24:23.317323 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:23.317405 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 00:24:23.317781 4231 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:24:23.795800 4235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:23.794748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:36075)
0812 00:24:23.795327 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:23.795473 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":289,"threads_started":1}
I20260812 00:24:24.282480 4237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:24.281627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:51743)
0812 00:24:24.282175 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:24.282275 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":260,"threads_started":1}
I20260812 00:24:24.319653 4238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:24.318487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:38485)
0812 00:24:24.319220 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:24.319381 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":292,"threads_started":1}
I20260812 00:24:24.797863 4239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:24.796940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:55827)
0812 00:24:24.797511 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:24.797669 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":290,"threads_started":1}
I20260812 00:24:25.284356 4240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:25.283494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:42971)
0812 00:24:25.284035 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:25.284159 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":287,"threads_started":1}
I20260812 00:24:25.321555 4241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:25.320785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:40085)
0812 00:24:25.321276 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:25.321373 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":233,"threads_started":1}
I20260812 00:24:25.799948 4243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:25.799085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:52617)
0812 00:24:25.799660 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:25.799759 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":289,"threads_started":1}
I20260812 00:24:26.286429 4244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:26.285496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:37025)
0812 00:24:26.286122 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:26.286238 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":348,"threads_started":1}
I20260812 00:24:26.323490 4245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:26.322677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:53403)
0812 00:24:26.323190 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:26.323289 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":258,"threads_started":1}
I20260812 00:24:26.802246 4247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:26.801213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:59219)
0812 00:24:26.801865 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:26.801994 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":428,"threads_started":1}
I20260812 00:24:27.288527 4248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:27.287649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:49521)
0812 00:24:27.288231 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:27.288336 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":304,"threads_started":1}
I20260812 00:24:27.325536 4249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:27.324622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:44555)
0812 00:24:27.325229 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:27.325334 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":294,"threads_started":1}
I20260812 00:24:27.804272 4250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:27.803440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:52777)
0812 00:24:27.803976 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:27.804073 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":273,"threads_started":1}
I20260812 00:24:28.290817 4251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:28.289894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:52919)
0812 00:24:28.290516 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:28.290637 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":348,"threads_started":1}
I20260812 00:24:28.327486 4252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:28.326642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:44089)
0812 00:24:28.327193 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:28.327290 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":288,"threads_started":1}
I20260812 00:24:28.806383 4253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:28.805458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:33763)
0812 00:24:28.806094 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:28.806203 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":374,"threads_started":1}
I20260812 00:24:29.292917 4254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:29.292009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:37681)
0812 00:24:29.292580 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:29.292686 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":258,"threads_started":1}
I20260812 00:24:29.329511 4255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:29.328576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:35349)
0812 00:24:29.329145 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:29.329251 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":278,"threads_started":1}
I20260812 00:24:29.808607 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:29.807559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:33407)
0812 00:24:29.808194 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:29.808294 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":292,"threads_started":1}
I20260812 00:24:30.295017 4260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:30.294136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:33365)
0812 00:24:30.294735 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:30.294834 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":288,"threads_started":1}
I20260812 00:24:30.331621 4261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:30.330730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:33513)
0812 00:24:30.331291 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:30.331390 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":235,"threads_started":1}
I20260812 00:24:30.810505 4262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:30.809731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:38597)
0812 00:24:30.810236 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:30.810330 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":244,"threads_started":1}
I20260812 00:24:31.296804 4264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:31.295954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:42821)
0812 00:24:31.296506 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:31.296599 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":278,"threads_started":1}
I20260812 00:24:31.333664 4265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:31.332768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:56325)
0812 00:24:31.333283 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:31.333379 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":242,"threads_started":1}
I20260812 00:24:31.812436 4266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:31.811573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:40051)
0812 00:24:31.812133 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:31.812234 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":265,"threads_started":1}
I20260812 00:24:32.298858 4267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:32.298040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:52415)
0812 00:24:32.298573 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:32.298673 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":284,"threads_started":1}
I20260812 00:24:32.335654 4268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:32.334784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:45887)
0812 00:24:32.335371 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:32.335460 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":306,"threads_started":1}
I20260812 00:24:32.814785 4269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:32.813868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:35679)
0812 00:24:32.814454 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:32.814582 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":324,"threads_started":1}
I20260812 00:24:33.300859 4270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:33.299908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:58179)
0812 00:24:33.300534 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:33.300651 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":292,"threads_started":1}
I20260812 00:24:33.337525 4271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:33.336724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:38373)
0812 00:24:33.337234 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:33.337349 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":271,"threads_started":1}
I20260812 00:24:33.816774 4272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:33.815968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:37939)
0812 00:24:33.816480 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:33.816584 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":258,"threads_started":1}
I20260812 00:24:34.302776 4273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:34.302013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:41675)
0812 00:24:34.302493 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:34.302588 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":231,"threads_started":1}
I20260812 00:24:34.339469 4274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:34.338626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:38029)
0812 00:24:34.339142 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:34.339261 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":258,"threads_started":1}
I20260812 00:24:34.818672 4275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:34.817903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:59635)
0812 00:24:34.818380 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:34.818470 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":228,"threads_started":1}
I20260812 00:24:35.304771 4276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:35.303901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:35125)
0812 00:24:35.304440 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:35.304547 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":260,"threads_started":1}
I20260812 00:24:35.341243 4277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:35.340507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:58533)
0812 00:24:35.340972 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:35.341068 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":262,"threads_started":1}
I20260812 00:24:35.820596 4279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:35.819770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:45865)
0812 00:24:35.820290 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:35.820393 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":230,"threads_started":1}
I20260812 00:24:36.306751 4280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:36.305892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:33435)
0812 00:24:36.306385 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:36.306486 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":252,"threads_started":1}
I20260812 00:24:36.343626 4281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:36.342598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:32847)
0812 00:24:36.343235 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:36.343393 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":310,"threads_started":1}
I20260812 00:24:36.822468 4282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:36.821669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:44445)
0812 00:24:36.822171 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:36.822277 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":256,"threads_started":1}
I20260812 00:24:37.309020 4283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:37.308081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:42177)
0812 00:24:37.308657 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:37.308785 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":254,"threads_started":1}
I20260812 00:24:37.345534 4284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:37.344705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:45645)
0812 00:24:37.345219 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:37.345318 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":256,"threads_started":1}
I20260812 00:24:37.824680 4285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:37.823894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.194:32949)
0812 00:24:37.824378 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:37.824483 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":256,"threads_started":1}
I20260812 00:24:38.310972 4286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:38.310152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.193:34591)
0812 00:24:38.310724 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:38.310815 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":313,"threads_started":1}
I20260812 00:24:38.319716 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 3745
I20260812 00:24:38.347229 4287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:38.321035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56616 (local address 127.18.163.193:34127)
0812 00:24:38.321775 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:38.321796 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:38.321944 (+ 148us) server_negotiation.cc:407] Connection header received
0812 00:24:38.323992 (+ 2048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:38.324003 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:38.324576 (+ 573us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:38.324997 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:38.326762 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:38.328075 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:38.329515 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:38.330348 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:38.330572 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:38.339790 (+ 9218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:38.339801 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:38.339819 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:38.339881 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:38.343200 (+ 3319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:38.344130 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:38.344140 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:38.344148 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:38.344344 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:38.344805 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:38.344808 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:38.344811 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:38.345434 (+ 623us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:38.345866 (+ 432us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:38.346394 (+ 528us) server_negotiation.cc:299] Negotiation successful
0812 00:24:38.346892 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":301,"threads_started":1}
I20260812 00:24:38.347879 4288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:38.346970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:46211 (local address 127.18.163.195:37355)
0812 00:24:38.347526 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:38.347668 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:46211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":357,"threads_started":1}
I20260812 00:24:38.348933 3922 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:38.441002 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 3745
I20260812 00:24:38.468951 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 3931
I20260812 00:24:38.489349 4290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:38.470075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51500 (local address 127.18.163.194:43263)
0812 00:24:38.470779 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:38.470795 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:38.470837 (+ 42us) server_negotiation.cc:407] Connection header received
0812 00:24:38.472441 (+ 1604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:38.472453 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:38.472935 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:38.473347 (+ 412us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:38.475199 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:38.476547 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:38.478012 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:38.478793 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:38.479028 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:38.482094 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:38.482104 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:38.482122 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:38.482179 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:38.485337 (+ 3158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:38.486369 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:38.486377 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:38.486385 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:38.486609 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:38.487076 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:38.487080 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:38.487082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:38.487693 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:38.488059 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:38.488559 (+ 500us) server_negotiation.cc:299] Negotiation successful
0812 00:24:38.489043 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":294,"threads_started":1}
I20260812 00:24:38.490991 4067 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:38.579756 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 3931
I20260812 00:24:38.604075 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 4078
I20260812 00:24:38.624183 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:38.605155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47582 (local address 127.18.163.195:33545)
0812 00:24:38.605862 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:38.605877 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:38.605925 (+ 48us) server_negotiation.cc:407] Connection header received
0812 00:24:38.607685 (+ 1760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:38.607697 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:38.608173 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:38.608573 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:38.610475 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:38.611815 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:38.613186 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:38.614025 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:38.614262 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:38.617226 (+ 2964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:38.617235 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:38.617253 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:38.617306 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:38.620329 (+ 3023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:38.621154 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:38.621163 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:38.621170 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:38.621365 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:38.621865 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:38.621870 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:38.621875 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:38.622467 (+ 592us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:38.622870 (+ 403us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:38.623339 (+ 469us) server_negotiation.cc:299] Negotiation successful
0812 00:24:38.623854 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":300,"threads_started":1}
I20260812 00:24:38.625869 4225 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:38.714172 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 4078
2026-08-12T00:24:38Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25815 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:24:38 dist-test-slave-njxd krb5kdc[4296](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:24:38 dist-test-slave-njxd krb5kdc[4296](info): set up 2 sockets
Aug 12 00:24:38 dist-test-slave-njxd krb5kdc[4296](info): commencing operation
krb5kdc: starting...
W20260812 00:24:39.935936 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.001s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:24:40 dist-test-slave-njxd krb5kdc[4296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:24:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:24:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:24:40.294178 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:34895
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:34895
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:24:40.688112 4311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:40.688510 4311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:40.688707 4311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:40.696364 4311 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 00:24:40.696547 4311 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 00:24:40.696660 4311 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 00:24:40.696763 4311 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:24:40.696870 4311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:40.697001 4311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:40.697094 4311 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:24:40.697181 4311 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:24:40.707772 4311 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:34895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:34895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:40.709379 4311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:40.710937 4311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:40.724298 4318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:40.724273 4317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:40.724272 4320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:40.730832 4311 server_base.cc:1034] running on GCE node
I20260812 00:24:40.731807 4311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:40.733479 4311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:40.734828 4311 hybrid_clock.cc:648] HybridClock initialized: now 1786494280734758 us; error 46 us; skew 500 ppm
I20260812 00:24:40.735239 4311 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:40 dist-test-slave-njxd krb5kdc[4296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494280, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:40.739042 4311 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:24:40.740935 4311 webserver.cc:460] Webserver started at http://127.18.163.254:40345/ using document root <none> and password file <none>
I20260812 00:24:40.742005 4311 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:40.742156 4311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:40.742537 4311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:24:40.746080 4311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "b1868512160a4ce1aacf868ba0fa8467"
format_stamp: "Formatted at 2026-08-12 00:24:40 on dist-test-slave-njxd"
server_key: "c9edee1444a3008f8de2affca6534955"
server_key_iv: "f79b18fda95908377b2549d4e56bf59c"
server_key_version: "encryptionkey@0"
I20260812 00:24:40.747015 4311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "b1868512160a4ce1aacf868ba0fa8467"
format_stamp: "Formatted at 2026-08-12 00:24:40 on dist-test-slave-njxd"
server_key: "c9edee1444a3008f8de2affca6534955"
server_key_iv: "f79b18fda95908377b2549d4e56bf59c"
server_key_version: "encryptionkey@0"
I20260812 00:24:40.753185 4311 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:24:40.757444 4327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:40.759229 4311 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:24:40.759483 4311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "b1868512160a4ce1aacf868ba0fa8467"
format_stamp: "Formatted at 2026-08-12 00:24:40 on dist-test-slave-njxd"
server_key: "c9edee1444a3008f8de2affca6534955"
server_key_iv: "f79b18fda95908377b2549d4e56bf59c"
server_key_version: "encryptionkey@0"
I20260812 00:24:40.759778 4311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:40.793262 4311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:40.798354 4311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:40.798686 4311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:40.819988 4311 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:34895
I20260812 00:24:40.820010 4385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:34895 every 8 connection(s)
I20260812 00:24:40.821564 4311 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:24:40.825935 4386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:40.832090 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 4311
I20260812 00:24:40.832341 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:24:40.833292 19087 external_mini_cluster.cc:1428] Setting key e3c7c43e6e892aa5a7c885d68c79637f
I20260812 00:24:40.839352 4386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Bootstrap starting.
I20260812 00:24:40.843904 4386 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Neither blocks nor log segments found. Creating new log.
I20260812 00:24:40.845429 4386 log.cc:824] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:40.849723 4386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: No bootstrap required, opened a new log
Aug 12 00:24:40 dist-test-slave-njxd krb5kdc[4296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:24:40.858631 4386 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } }
I20260812 00:24:40.859089 4386 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:40.859237 4386 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1868512160a4ce1aacf868ba0fa8467, State: Initialized, Role: FOLLOWER
I20260812 00:24:40.859949 4386 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } }
I20260812 00:24:40.860241 4386 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:24:40.860411 4386 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:24:40.860608 4386 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:40.861088 4389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:40.835940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33856 (local address 127.18.163.254:34895)
0812 00:24:40.837019 (+ 1079us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:40.837033 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:40.837082 (+ 49us) server_negotiation.cc:407] Connection header received
0812 00:24:40.839014 (+ 1932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:40.839042 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:40.839544 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:40.839975 (+ 431us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:40.842240 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:40.843621 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:40.845733 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:40.846894 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:40.847138 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:40.852359 (+ 5221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:40.852371 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:40.852389 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:40.852444 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:40.855953 (+ 3509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:40.856858 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:40.856865 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:40.856873 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:40.857084 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:40.857549 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:40.857553 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:40.857555 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:40.858239 (+ 684us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:40.858609 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:40.859141 (+ 532us) server_negotiation.cc:299] Negotiation successful
0812 00:24:40.859703 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":801,"thread_start_us":525,"threads_started":1}
I20260812 00:24:40.863353 4386 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } }
I20260812 00:24:40.863917 4386 leader_election.cc:302] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1868512160a4ce1aacf868ba0fa8467; no voters:
I20260812 00:24:40.864605 4386 leader_election.cc:288] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:24:40.864702 4391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:24:40.865653 4391 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 1 LEADER]: Becoming Leader. State: Replica: b1868512160a4ce1aacf868ba0fa8467, State: Running, Role: LEADER
I20260812 00:24:40.866257 4391 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } }
I20260812 00:24:40.866967 4386 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:24:40.869364 4393 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1868512160a4ce1aacf868ba0fa8467. Latest consensus state: current_term: 1 leader_uuid: "b1868512160a4ce1aacf868ba0fa8467" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } } }
I20260812 00:24:40.869939 4393 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [sys.catalog]: This master's current role is: LEADER
I20260812 00:24:40.870301 4392 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1868512160a4ce1aacf868ba0fa8467" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } } }
I20260812 00:24:40.871073 4392 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [sys.catalog]: This master's current role is: LEADER
I20260812 00:24:40.875012 4399 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:24:40.880194 4399 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:24:40.890467 4399 catalog_manager.cc:1347] Generated new cluster ID: fe9ee7849fa048b9a9f684079faa2b01
I20260812 00:24:40.890628 4399 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:24:40.902539 4399 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:24:40.904649 4399 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:24:40.915902 4399 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Generated new TSK 0
I20260812 00:24:40.917186 4399 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:24:41.002899 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34895
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:24:41.387692 4415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:41.388041 4415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:41.388245 4415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:41.396153 4415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:41.396306 4415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:41.396494 4415 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:24:41.407334 4415 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34895
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:41.408847 4415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:41.410385 4415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:41.426298 4421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:41.426288 4424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:41.426347 4422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:41.427543 4415 server_base.cc:1034] running on GCE node
I20260812 00:24:41.428192 4415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:41.429251 4415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:41.430509 4415 hybrid_clock.cc:648] HybridClock initialized: now 1786494281430443 us; error 61 us; skew 500 ppm
I20260812 00:24:41.430887 4415 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:41 dist-test-slave-njxd krb5kdc[4296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494281, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:41.434466 4415 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:24:41.436254 4415 webserver.cc:460] Webserver started at http://127.18.163.193:44849/ using document root <none> and password file <none>
I20260812 00:24:41.437000 4415 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:41.437119 4415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:41.437414 4415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:24:41.440742 4415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "15d2826f2c5c4c4bb867b9cb098eac08"
format_stamp: "Formatted at 2026-08-12 00:24:41 on dist-test-slave-njxd"
server_key: "6ceef411ce40041cf038c9dfea3fa5fd"
server_key_iv: "01c449ac2be8ca0dcd31657a944ae513"
server_key_version: "encryptionkey@0"
I20260812 00:24:41.441565 4415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "15d2826f2c5c4c4bb867b9cb098eac08"
format_stamp: "Formatted at 2026-08-12 00:24:41 on dist-test-slave-njxd"
server_key: "6ceef411ce40041cf038c9dfea3fa5fd"
server_key_iv: "01c449ac2be8ca0dcd31657a944ae513"
server_key_version: "encryptionkey@0"
I20260812 00:24:41.447782 4415 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:24:41.451947 4432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:41.453549 4415 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:24:41.453845 4415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "15d2826f2c5c4c4bb867b9cb098eac08"
format_stamp: "Formatted at 2026-08-12 00:24:41 on dist-test-slave-njxd"
server_key: "6ceef411ce40041cf038c9dfea3fa5fd"
server_key_iv: "01c449ac2be8ca0dcd31657a944ae513"
server_key_version: "encryptionkey@0"
I20260812 00:24:41.454072 4415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:41.471340 4415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:41.476182 4415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:41.476526 4415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:41.477789 4415 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:24:41.479382 4415 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:24:41.479465 4415 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:41.479689 4415 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:24:41.479746 4415 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:41.517524 4415 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:39689
I20260812 00:24:41.517663 4556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:39689 every 8 connection(s)
I20260812 00:24:41.519016 4415 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:24:41.520694 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 4415
I20260812 00:24:41.520946 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:24:41.521821 19087 external_mini_cluster.cc:1428] Setting key 46c4de3be46a2e36da12e3f5c0158fd7
Aug 12 00:24:41 dist-test-slave-njxd krb5kdc[4296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494281, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:24:41.542922 4559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:41.522370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:48445 (local address 127.18.163.254:34895)
0812 00:24:41.522956 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:41.522962 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:41.524029 (+ 1067us) server_negotiation.cc:407] Connection header received
0812 00:24:41.526193 (+ 2164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:41.526199 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:41.526301 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:41.526425 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:41.528163 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:41.528920 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:41.530718 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:41.531163 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:41.531320 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:41.535788 (+ 4468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:41.535795 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:41.535798 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:41.535840 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:41.538727 (+ 2887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:41.539810 (+ 1083us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:41.539820 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:41.539825 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:41.540014 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:41.540512 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:41.540519 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:41.540525 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:41.540966 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:41.541137 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:41.542070 (+ 933us) server_negotiation.cc:299] Negotiation successful
0812 00:24:41.542388 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":280,"threads_started":1}
I20260812 00:24:41.543892 4560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:41.523001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:48445)
0812 00:24:41.523842 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:41.523882 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:41.525873 (+ 1991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:41.526709 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:41.526719 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:41.527321 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:41.527953 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:41.527972 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:41.529133 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:41.529137 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:41.530545 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:41.530560 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:41.531440 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:41.531448 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:41.531734 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:41.532523 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:41.532552 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:41.535431 (+ 2879us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:41.538944 (+ 3513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:41.538959 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:41.538985 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:41.539628 (+ 643us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:41.540151 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:41.540155 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:41.540157 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:41.540370 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:41.541105 (+ 735us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:41.541111 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:41.541503 (+ 392us) client_negotiation.cc:769] Sending connection context
0812 00:24:41.541866 (+ 363us) client_negotiation.cc:240] Negotiation successful
0812 00:24:41.542388 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":344,"threads_started":1}
I20260812 00:24:41.545871 4557 heartbeater.cc:347] Connected to a master server at 127.18.163.254:34895
I20260812 00:24:41.546273 4557 heartbeater.cc:464] Registering TS with master...
I20260812 00:24:41.547348 4557 heartbeater.cc:511] Master 127.18.163.254:34895 requested a full tablet report, sending...
I20260812 00:24:41.550276 4347 ts_manager.cc:194] Registered new tserver with Master: 15d2826f2c5c4c4bb867b9cb098eac08 (127.18.163.193:39689)
I20260812 00:24:41.552023 4347 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:48445
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:24:41.603000 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34895
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:24:41.993248 4563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:41.993686 4563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:41.993867 4563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:42.001641 4563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:42.001833 4563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:42.002034 4563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:24:42.012506 4563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34895
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:42.014091 4563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:42.015578 4563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:42.030073 4572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:42.030150 4570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:42.030172 4569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:42.031103 4563 server_base.cc:1034] running on GCE node
I20260812 00:24:42.031826 4563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:42.032923 4563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:42.034188 4563 hybrid_clock.cc:648] HybridClock initialized: now 1786494282034134 us; error 60 us; skew 500 ppm
I20260812 00:24:42.034621 4563 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:42 dist-test-slave-njxd krb5kdc[4296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494282, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:42.038408 4563 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:24:42.040158 4563 webserver.cc:460] Webserver started at http://127.18.163.194:36847/ using document root <none> and password file <none>
I20260812 00:24:42.040921 4563 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:42.041038 4563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:42.041322 4563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:24:42.044831 4563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "9753bf9f35e943aaa22e12fab2f7e530"
format_stamp: "Formatted at 2026-08-12 00:24:42 on dist-test-slave-njxd"
server_key: "de6fbc51bb08907850ca7a2758f453ed"
server_key_iv: "36cd54961b2092aef711b37e1edcf89b"
server_key_version: "encryptionkey@0"
I20260812 00:24:42.045710 4563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "9753bf9f35e943aaa22e12fab2f7e530"
format_stamp: "Formatted at 2026-08-12 00:24:42 on dist-test-slave-njxd"
server_key: "de6fbc51bb08907850ca7a2758f453ed"
server_key_iv: "36cd54961b2092aef711b37e1edcf89b"
server_key_version: "encryptionkey@0"
I20260812 00:24:42.051582 4563 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:24:42.055801 4580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:42.057369 4563 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:24:42.057543 4563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "9753bf9f35e943aaa22e12fab2f7e530"
format_stamp: "Formatted at 2026-08-12 00:24:42 on dist-test-slave-njxd"
server_key: "de6fbc51bb08907850ca7a2758f453ed"
server_key_iv: "36cd54961b2092aef711b37e1edcf89b"
server_key_version: "encryptionkey@0"
I20260812 00:24:42.057847 4563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:42.082376 4563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:42.087618 4563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:42.087910 4563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:42.089022 4563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:24:42.090619 4563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:24:42.090705 4563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:42.090802 4563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:24:42.090849 4563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:42.128758 4563 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:36151
I20260812 00:24:42.128837 4707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:36151 every 8 connection(s)
I20260812 00:24:42.130781 4563 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:24:42.140250 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 4563
I20260812 00:24:42.140475 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:24:42.140959 19087 external_mini_cluster.cc:1428] Setting key f445967b9122ba527ae0500d72de79c7
Aug 12 00:24:42 dist-test-slave-njxd krb5kdc[4296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494282, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:24:42.154275 4712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:42.134250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:52789 (local address 127.18.163.254:34895)
0812 00:24:42.134793 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:42.134798 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:42.135858 (+ 1060us) server_negotiation.cc:407] Connection header received
0812 00:24:42.137976 (+ 2118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:42.137982 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:42.138088 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:42.138220 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:42.139976 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.140873 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.142716 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.143212 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.143360 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:42.147554 (+ 4194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:42.147559 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:42.147563 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:42.147608 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:42.150603 (+ 2995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:42.151546 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:42.151551 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:42.151553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:42.151712 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:42.152250 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:42.152255 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:42.152257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:42.152567 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:42.152767 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:42.153565 (+ 798us) server_negotiation.cc:299] Negotiation successful
0812 00:24:42.153869 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":269,"threads_started":1}
I20260812 00:24:42.155351 4713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:42.134875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:52789)
0812 00:24:42.135670 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:42.135721 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:42.137647 (+ 1926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:42.138501 (+ 854us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:42.138510 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:42.139121 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:42.139760 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:42.139779 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.141085 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.141097 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:42.142543 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:42.142560 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.143490 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.143499 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:42.143746 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:42.144562 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:42.144587 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:42.147257 (+ 2670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:42.150804 (+ 3547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:42.150815 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:42.150853 (+ 38us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:42.151376 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:42.151842 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:42.151848 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:42.151851 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:42.152102 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:42.152735 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:42.152744 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:42.153161 (+ 417us) client_negotiation.cc:769] Sending connection context
0812 00:24:42.153454 (+ 293us) client_negotiation.cc:240] Negotiation successful
0812 00:24:42.154116 (+ 662us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":307,"threads_started":1}
I20260812 00:24:42.157003 4709 heartbeater.cc:347] Connected to a master server at 127.18.163.254:34895
I20260812 00:24:42.157393 4709 heartbeater.cc:464] Registering TS with master...
I20260812 00:24:42.158429 4709 heartbeater.cc:511] Master 127.18.163.254:34895 requested a full tablet report, sending...
I20260812 00:24:42.160450 4347 ts_manager.cc:194] Registered new tserver with Master: 9753bf9f35e943aaa22e12fab2f7e530 (127.18.163.194:36151)
I20260812 00:24:42.161324 4347 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:52789
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
I20260812 00:24:42.220940 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34895
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:24:42.556733 4557 heartbeater.cc:503] Master 127.18.163.254:34895 was elected leader, sending a full tablet report...
W20260812 00:24:42.663501 4717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:24:42.663983 4717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:24:42.664197 4717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:24:42.681310 4717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:24:42.681526 4717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:24:42.681846 4717 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:24:42.704080 4717 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34895
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:24:42.706212 4717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:24:42.708231 4717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:24:42.726589 4723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:42.726580 4724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:24:42.727195 4726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:24:42.728123 4717 server_base.cc:1034] running on GCE node
I20260812 00:24:42.729041 4717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:24:42.730501 4717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:24:42.731791 4717 hybrid_clock.cc:648] HybridClock initialized: now 1786494282731728 us; error 68 us; skew 500 ppm
I20260812 00:24:42.732267 4717 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:24:42 dist-test-slave-njxd krb5kdc[4296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494282, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:24:42.736949 4717 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:24:42.738826 4717 webserver.cc:460] Webserver started at http://127.18.163.195:39697/ using document root <none> and password file <none>
I20260812 00:24:42.739708 4717 fs_manager.cc:359] Metadata directory not provided
I20260812 00:24:42.739868 4717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:24:42.740226 4717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:24:42.743525 4717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167"
format_stamp: "Formatted at 2026-08-12 00:24:42 on dist-test-slave-njxd"
server_key: "8a6c7527b8cb21d960e400163e50558a"
server_key_iv: "7876f1523a2a618ebca8ceb4e4bb76a6"
server_key_version: "encryptionkey@0"
I20260812 00:24:42.744407 4717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167"
format_stamp: "Formatted at 2026-08-12 00:24:42 on dist-test-slave-njxd"
server_key: "8a6c7527b8cb21d960e400163e50558a"
server_key_iv: "7876f1523a2a618ebca8ceb4e4bb76a6"
server_key_version: "encryptionkey@0"
I20260812 00:24:42.750716 4717 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260812 00:24:42.755101 4735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:42.756839 4717 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 00:24:42.757051 4717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167"
format_stamp: "Formatted at 2026-08-12 00:24:42 on dist-test-slave-njxd"
server_key: "8a6c7527b8cb21d960e400163e50558a"
server_key_iv: "7876f1523a2a618ebca8ceb4e4bb76a6"
server_key_version: "encryptionkey@0"
I20260812 00:24:42.757354 4717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:24:42.774699 4717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:24:42.780033 4717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:24:42.780433 4717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:24:42.781561 4717 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:24:42.783181 4717 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:24:42.783288 4717 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:42.783444 4717 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:24:42.783524 4717 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:24:42.834770 4717 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:33817
I20260812 00:24:42.834793 4869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:33817 every 8 connection(s)
I20260812 00:24:42.836163 4717 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:24:42.841955 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 4717
I20260812 00:24:42.842219 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:24:42.842845 19087 external_mini_cluster.cc:1428] Setting key a0465f0d92e10bf34ace2a3c147a7fa0
Aug 12 00:24:42 dist-test-slave-njxd krb5kdc[4296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494282, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:24:42.860793 4872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:42.839303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:38271 (local address 127.18.163.254:34895)
0812 00:24:42.839810 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:42.839814 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:42.841112 (+ 1298us) server_negotiation.cc:407] Connection header received
0812 00:24:42.843967 (+ 2855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:42.843977 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:42.844096 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:42.844254 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:42.846448 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.847377 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.849229 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.849747 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.849894 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:42.853846 (+ 3952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:42.853852 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:42.853855 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:42.853902 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:42.856752 (+ 2850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:42.857687 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:42.857691 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:42.857694 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:42.857827 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:42.858366 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:42.858370 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:42.858373 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:42.858765 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:42.858886 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:42.860072 (+ 1186us) server_negotiation.cc:299] Negotiation successful
0812 00:24:42.860327 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":277,"threads_started":1}
I20260812 00:24:42.862088 4873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:42.840039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:38271)
0812 00:24:42.840899 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:42.840946 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:42.843549 (+ 2603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:42.844571 (+ 1022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:42.844581 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:42.845430 (+ 849us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:24:42.846265 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:42.846285 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.847547 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.847555 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:42.849049 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:42.849072 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.850012 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.850020 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:42.850312 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:42.851116 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:24:42.851141 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:24:42.853528 (+ 2387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:24:42.856936 (+ 3408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:42.856945 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:42.856967 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:42.857510 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:42.857953 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:24:42.857958 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:24:42.857962 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:24:42.858205 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:24:42.859003 (+ 798us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:24:42.859012 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:24:42.859559 (+ 547us) client_negotiation.cc:769] Sending connection context
0812 00:24:42.859946 (+ 387us) client_negotiation.cc:240] Negotiation successful
0812 00:24:42.860557 (+ 611us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":359,"threads_started":1}
I20260812 00:24:42.863860 4870 heartbeater.cc:347] Connected to a master server at 127.18.163.254:34895
I20260812 00:24:42.864286 4870 heartbeater.cc:464] Registering TS with master...
I20260812 00:24:42.865515 4870 heartbeater.cc:511] Master 127.18.163.254:34895 requested a full tablet report, sending...
I20260812 00:24:42.867550 4347 ts_manager.cc:194] Registered new tserver with Master: 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817)
I20260812 00:24:42.868532 4347 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:38271
I20260812 00:24:42.874743 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:24:42.894843 4872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:42.880953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47352 (local address 127.18.163.254:34895)
0812 00:24:42.881140 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:42.881145 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:42.881693 (+ 548us) server_negotiation.cc:407] Connection header received
0812 00:24:42.881859 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:42.881863 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:42.881951 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:42.882048 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:42.883718 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.884503 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.886086 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.886538 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.886644 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:42.889312 (+ 2668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:42.889317 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:42.889321 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:42.889360 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:42.892094 (+ 2734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:42.892891 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:42.892896 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:42.892898 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:42.893045 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:42.893385 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:42.893389 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:42.893391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:42.893825 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:42.894028 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:42.894366 (+ 338us) server_negotiation.cc:299] Negotiation successful
0812 00:24:42.894583 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 00:24:42.899596 4347 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47352:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:24:42.907042 4347 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:24:42.955008 4891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:42.923623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54498 (local address 127.18.163.195:33817)
0812 00:24:42.943597 (+ 19974us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:42.943612 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:42.946798 (+ 3186us) server_negotiation.cc:407] Connection header received
0812 00:24:42.947156 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:42.947165 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:42.947446 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:42.947679 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:42.948318 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.949925 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.952012 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.953618 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.953866 (+ 248us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:42.954068 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:42.954410 (+ 342us) server_negotiation.cc:299] Negotiation successful
0812 00:24:42.954602 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19650,"thread_start_us":20016,"threads_started":1}
I20260812 00:24:42.955403 4890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:42.923126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:33817 (local address 127.0.0.1:54498)
0812 00:24:42.946628 (+ 23502us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:42.946676 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:42.946913 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:42.947689 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:42.947695 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:42.947724 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:42.948106 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:42.948118 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.950078 (+ 1960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.950085 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:42.951834 (+ 1749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:42.951848 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.953863 (+ 2015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.953870 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:42.954115 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:42.954179 (+ 64us) client_negotiation.cc:769] Sending connection context
0812 00:24:42.954345 (+ 166us) client_negotiation.cc:240] Negotiation successful
0812 00:24:42.954586 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23331,"mutex_wait_us":78,"thread_start_us":23145,"threads_started":1}
I20260812 00:24:42.955708 4888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:42.920838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:39689 (local address 127.0.0.1:44034)
0812 00:24:42.944516 (+ 23678us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:42.944557 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:42.944771 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:42.946496 (+ 1725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:42.946504 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:42.946543 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:42.947177 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:42.947198 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.948999 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.949006 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:42.951826 (+ 2820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:42.951845 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.953991 (+ 2146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.954000 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:42.954247 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:42.954356 (+ 109us) client_negotiation.cc:769] Sending connection context
0812 00:24:42.954442 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 00:24:42.954610 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23502,"mutex_wait_us":217,"thread_start_us":23300,"threads_started":1}
I20260812 00:24:42.955855 4885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:42.920842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38670 (local address 127.18.163.194:36151)
0812 00:24:42.945398 (+ 24556us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:42.945407 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:42.945442 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:24:42.945596 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:42.945606 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:42.945910 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:42.947446 (+ 1536us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:42.947753 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.949405 (+ 1652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.952262 (+ 2857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.953768 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.954296 (+ 528us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:42.954487 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:42.955326 (+ 839us) server_negotiation.cc:299] Negotiation successful
0812 00:24:42.955528 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24360,"thread_start_us":25261,"threads_started":1}
I20260812 00:24:42.956106 4889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:42.921452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44034 (local address 127.18.163.193:39689)
0812 00:24:42.945398 (+ 23946us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:42.945407 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:42.945442 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:24:42.945604 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:42.945613 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:42.945910 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:42.946450 (+ 540us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:42.947426 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.948850 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.952074 (+ 3224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.953694 (+ 1620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.955275 (+ 1581us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:42.955503 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:42.955584 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 00:24:42.955768 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23758,"thread_start_us":24583,"threads_started":1}
I20260812 00:24:42.956313 4883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:42.920410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:36151 (local address 127.0.0.1:38670)
0812 00:24:42.922614 (+ 2204us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:42.922664 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:42.922858 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:42.946793 (+ 23935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:42.946798 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:42.946830 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:42.947326 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:42.947342 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.949615 (+ 2273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.949623 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:42.952067 (+ 2444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:42.952080 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:42.954028 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:42.954033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:42.954585 (+ 552us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:42.954615 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 00:24:42.954697 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 00:24:42.954849 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1946,"mutex_wait_us":357,"thread_start_us":1750,"threads_started":1}
I20260812 00:24:42.959898 4634 tablet_service.cc:1467] Processing CreateTablet for tablet 1df43edc6c4a49b5a5270e2af52b67d8 (DEFAULT_TABLE table=test-table [id=8284dafe919343cc81fa1ef594cc41fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:24:42.960039 4794 tablet_service.cc:1467] Processing CreateTablet for tablet 1df43edc6c4a49b5a5270e2af52b67d8 (DEFAULT_TABLE table=test-table [id=8284dafe919343cc81fa1ef594cc41fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:24:42.961480 4634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1df43edc6c4a49b5a5270e2af52b67d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:42.961642 4794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1df43edc6c4a49b5a5270e2af52b67d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:42.963490 4487 tablet_service.cc:1467] Processing CreateTablet for tablet 1df43edc6c4a49b5a5270e2af52b67d8 (DEFAULT_TABLE table=test-table [id=8284dafe919343cc81fa1ef594cc41fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:24:42.965293 4487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1df43edc6c4a49b5a5270e2af52b67d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:24:42.974169 4893 tablet_bootstrap.cc:492] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530: Bootstrap starting.
I20260812 00:24:42.977342 4894 tablet_bootstrap.cc:492] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Bootstrap starting.
I20260812 00:24:42.978370 4893 tablet_bootstrap.cc:654] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530: Neither blocks nor log segments found. Creating new log.
I20260812 00:24:42.979910 4893 log.cc:824] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:42.981153 4894 tablet_bootstrap.cc:654] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Neither blocks nor log segments found. Creating new log.
I20260812 00:24:42.982259 4896 tablet_bootstrap.cc:492] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08: Bootstrap starting.
I20260812 00:24:42.982561 4894 log.cc:824] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:42.984001 4893 tablet_bootstrap.cc:492] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530: No bootstrap required, opened a new log
I20260812 00:24:42.984354 4893 ts_tablet_manager.cc:1397] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.001s
I20260812 00:24:42.986059 4896 tablet_bootstrap.cc:654] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08: Neither blocks nor log segments found. Creating new log.
I20260812 00:24:42.986277 4894 tablet_bootstrap.cc:492] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167: No bootstrap required, opened a new log
I20260812 00:24:42.986552 4894 ts_tablet_manager.cc:1397] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.002s
I20260812 00:24:42.987488 4896 log.cc:824] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08: Log is configured to *not* fsync() on all Append() calls
I20260812 00:24:42.990535 4896 tablet_bootstrap.cc:492] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08: No bootstrap required, opened a new log
I20260812 00:24:42.990859 4896 ts_tablet_manager.cc:1397] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.006s
I20260812 00:24:42.995946 4893 raft_consensus.cc:348] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:24:42.996505 4893 raft_consensus.cc:374] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:42.996634 4893 raft_consensus.cc:729] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9753bf9f35e943aaa22e12fab2f7e530, State: Initialized, Role: FOLLOWER
I20260812 00:24:42.997360 4893 consensus_queue.cc:260] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:24:42.997797 4894 raft_consensus.cc:348] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:24:42.998401 4894 raft_consensus.cc:374] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:42.998551 4894 raft_consensus.cc:729] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 322f0f3aae3d4ac6b67d8e3e7ce56167, State: Initialized, Role: FOLLOWER
I20260812 00:24:42.998781 4709 heartbeater.cc:503] Master 127.18.163.254:34895 was elected leader, sending a full tablet report...
I20260812 00:24:42.998907 4896 raft_consensus.cc:348] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:24:42.999343 4896 raft_consensus.cc:374] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:24:42.999436 4896 raft_consensus.cc:729] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15d2826f2c5c4c4bb867b9cb098eac08, State: Initialized, Role: FOLLOWER
I20260812 00:24:42.999280 4894 consensus_queue.cc:260] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:24:42.999949 4893 ts_tablet_manager.cc:1428] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530: Time spent starting tablet: real 0.015s user 0.011s sys 0.006s
I20260812 00:24:43.000065 4896 consensus_queue.cc:260] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:24:43.001400 4870 heartbeater.cc:503] Master 127.18.163.254:34895 was elected leader, sending a full tablet report...
I20260812 00:24:43.002197 4894 ts_tablet_manager.cc:1428] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Time spent starting tablet: real 0.016s user 0.005s sys 0.011s
I20260812 00:24:43.004350 4896 ts_tablet_manager.cc:1428] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08: Time spent starting tablet: real 0.013s user 0.013s sys 0.001s
W20260812 00:24:43.022148 4558 tablet.cc:2369] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:24:43.088313 4871 tablet.cc:2369] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:24:43.114925 4902 raft_consensus.cc:482] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:24:43.115319 4902 raft_consensus.cc:504] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:24:43.117484 4902 leader_election.cc:288] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9753bf9f35e943aaa22e12fab2f7e530 (127.18.163.194:36151), 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817)
I20260812 00:24:43.125036 4885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:43.117993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:58395 (local address 127.18.163.194:36151)
0812 00:24:43.118248 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:43.118253 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:43.118602 (+ 349us) server_negotiation.cc:407] Connection header received
0812 00:24:43.118841 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:43.118847 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:43.118936 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:43.119041 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:43.119789 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:43.120981 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:43.123053 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:43.123913 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:43.124054 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:43.124115 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:43.124591 (+ 476us) server_negotiation.cc:299] Negotiation successful
0812 00:24:43.124748 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:24:43.125135 4903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:43.117733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:36151 (local address 127.18.163.193:58395)
0812 00:24:43.118477 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:43.118505 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:43.118656 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:43.119127 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:43.119134 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:43.119171 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:43.119587 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:43.119602 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:43.121137 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:43.121143 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:43.122862 (+ 1719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:43.122877 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:43.124152 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:43.124160 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:43.124392 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:43.124432 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 00:24:43.124541 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 00:24:43.124673 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"mutex_wait_us":1,"thread_start_us":402,"threads_started":1}
I20260812 00:24:43.125325 4891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:43.118797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:59081 (local address 127.18.163.195:33817)
0812 00:24:43.119014 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:43.119023 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:43.119431 (+ 408us) server_negotiation.cc:407] Connection header received
0812 00:24:43.119557 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:43.119565 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:43.119649 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:43.119759 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:24:43.120406 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:43.121266 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:43.123235 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:43.124273 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:43.124447 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:43.124537 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:43.124914 (+ 377us) server_negotiation.cc:299] Negotiation successful
0812 00:24:43.125062 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:24:43.125665 4904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:43.118600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:33817 (local address 127.18.163.193:59081)
0812 00:24:43.119303 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0812 00:24:43.119318 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:24:43.119430 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:24:43.119787 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:24:43.119791 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:24:43.119817 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:24:43.120219 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:43.120232 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:43.121427 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:43.121431 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:43.123005 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:24:43.123023 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:24:43.124498 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:24:43.124525 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:24:43.124725 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:43.124757 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 00:24:43.124862 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 00:24:43.124999 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":359,"threads_started":1}
I20260812 00:24:43.126377 4656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df43edc6c4a49b5a5270e2af52b67d8" candidate_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9753bf9f35e943aaa22e12fab2f7e530" is_pre_election: true
I20260812 00:24:43.126792 4817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df43edc6c4a49b5a5270e2af52b67d8" candidate_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" is_pre_election: true
I20260812 00:24:43.127025 4656 raft_consensus.cc:2454] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15d2826f2c5c4c4bb867b9cb098eac08 in term 0.
I20260812 00:24:43.127354 4817 raft_consensus.cc:2454] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15d2826f2c5c4c4bb867b9cb098eac08 in term 0.
I20260812 00:24:43.127933 4433 leader_election.cc:302] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15d2826f2c5c4c4bb867b9cb098eac08, 9753bf9f35e943aaa22e12fab2f7e530; no voters:
I20260812 00:24:43.128427 4902 raft_consensus.cc:2781] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:24:43.128605 4902 raft_consensus.cc:482] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:24:43.128741 4902 raft_consensus.cc:3037] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:43.132143 4902 raft_consensus.cc:504] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:24:43.133030 4902 leader_election.cc:288] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 1 election: Requested vote from peers 9753bf9f35e943aaa22e12fab2f7e530 (127.18.163.194:36151), 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817)
W20260812 00:24:43.133661 4711 tablet.cc:2369] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:24:43.133701 4817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df43edc6c4a49b5a5270e2af52b67d8" candidate_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167"
I20260812 00:24:43.133687 4656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df43edc6c4a49b5a5270e2af52b67d8" candidate_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9753bf9f35e943aaa22e12fab2f7e530"
I20260812 00:24:43.133949 4817 raft_consensus.cc:3037] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:43.133975 4656 raft_consensus.cc:3037] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:24:43.136577 4656 raft_consensus.cc:2454] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15d2826f2c5c4c4bb867b9cb098eac08 in term 1.
I20260812 00:24:43.137096 4433 leader_election.cc:302] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15d2826f2c5c4c4bb867b9cb098eac08, 9753bf9f35e943aaa22e12fab2f7e530; no voters:
I20260812 00:24:43.137279 4817 raft_consensus.cc:2454] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15d2826f2c5c4c4bb867b9cb098eac08 in term 1.
I20260812 00:24:43.137434 4902 raft_consensus.cc:2781] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:24:43.138141 4902 raft_consensus.cc:686] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 LEADER]: Becoming Leader. State: Replica: 15d2826f2c5c4c4bb867b9cb098eac08, State: Running, Role: LEADER
I20260812 00:24:43.138742 4902 consensus_queue.cc:237] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:24:43.144207 4345 catalog_manager.cc:5495] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15d2826f2c5c4c4bb867b9cb098eac08 (127.18.163.193). New cstate: current_term: 1 leader_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } health_report { overall_health: UNKNOWN } } }
I20260812 00:24:43.178507 4889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:43.172533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44038 (local address 127.18.163.193:39689)
0812 00:24:43.172749 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:43.172754 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:43.172773 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:24:43.172992 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:43.172997 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:43.173106 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:43.173255 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:24:43.173683 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:43.174443 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:43.175932 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:43.176457 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:43.176565 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:43.177313 (+ 748us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:24:43.177960 (+ 647us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:24:43.178074 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:43.178203 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 00:24:43.178287 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:24:43.187805 4817 raft_consensus.cc:1261] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 1 FOLLOWER]: Refusing update from remote peer 15d2826f2c5c4c4bb867b9cb098eac08: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:24:43.187801 4656 raft_consensus.cc:1261] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530 [term 1 FOLLOWER]: Refusing update from remote peer 15d2826f2c5c4c4bb867b9cb098eac08: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:24:43.188898 4902 consensus_queue.cc:1035] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:24:43.189258 4905 consensus_queue.cc:1035] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:24:43.221316 4346 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:24:43.221678 4346 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:24:43.226580 4346 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Sending DeleteTablet for 3 replicas of tablet 1df43edc6c4a49b5a5270e2af52b67d8
I20260812 00:24:43.228155 4634 tablet_service.cc:1514] Processing DeleteTablet for tablet 1df43edc6c4a49b5a5270e2af52b67d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:24:43 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:38670
I20260812 00:24:43.228155 4487 tablet_service.cc:1514] Processing DeleteTablet for tablet 1df43edc6c4a49b5a5270e2af52b67d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:24:43 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:44034
I20260812 00:24:43.228670 4794 tablet_service.cc:1514] Processing DeleteTablet for tablet 1df43edc6c4a49b5a5270e2af52b67d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:24:43 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:54498
I20260812 00:24:43.229667 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 4415
I20260812 00:24:43.239563 4921 tablet_replica.cc:330] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167: stopping tablet replica
I20260812 00:24:43.240162 4921 raft_consensus.cc:2229] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:24:43.240832 4921 raft_consensus.cc:2258] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:24:43.243664 4921 ts_tablet_manager.cc:1905] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:24:43.250574 4920 tablet_replica.cc:330] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530: stopping tablet replica
I20260812 00:24:43.251152 4920 raft_consensus.cc:2229] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:24:43.251791 4920 raft_consensus.cc:2258] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:24:43.252786 4919 tablet_replica.cc:330] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08: stopping tablet replica
I20260812 00:24:43.253286 4919 raft_consensus.cc:2229] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:24:43.254097 4919 raft_consensus.cc:2258] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:24:43.254652 4920 ts_tablet_manager.cc:1905] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:24:43.256217 4921 ts_tablet_manager.cc:1918] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:24:43.256502 4921 log.cc:1196] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/1df43edc6c4a49b5a5270e2af52b67d8
I20260812 00:24:43.256738 4919 ts_tablet_manager.cc:1905] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:24:43.257264 4921 ts_tablet_manager.cc:1939] T 1df43edc6c4a49b5a5270e2af52b67d8 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Deleting consensus metadata
Aug 12 00:24:43 dist-test-slave-njxd krb5kdc[4296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:24:43.259821 4329 catalog_manager.cc:4841] TS 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817): tablet 1df43edc6c4a49b5a5270e2af52b67d8 (table test-table [id=8284dafe919343cc81fa1ef594cc41fa]) successfully deleted
I20260812 00:24:43.262763 4920 ts_tablet_manager.cc:1918] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:24:43.262966 4920 log.cc:1196] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/1df43edc6c4a49b5a5270e2af52b67d8
I20260812 00:24:43.263696 4920 ts_tablet_manager.cc:1939] T 1df43edc6c4a49b5a5270e2af52b67d8 P 9753bf9f35e943aaa22e12fab2f7e530: Deleting consensus metadata
I20260812 00:24:43.266043 4329 catalog_manager.cc:4841] TS 9753bf9f35e943aaa22e12fab2f7e530 (127.18.163.194:36151): tablet 1df43edc6c4a49b5a5270e2af52b67d8 (table test-table [id=8284dafe919343cc81fa1ef594cc41fa]) successfully deleted
I20260812 00:24:43.266325 4919 ts_tablet_manager.cc:1918] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:24:43.266548 4919 log.cc:1196] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/1df43edc6c4a49b5a5270e2af52b67d8
I20260812 00:24:43.267139 4919 ts_tablet_manager.cc:1939] T 1df43edc6c4a49b5a5270e2af52b67d8 P 15d2826f2c5c4c4bb867b9cb098eac08: Deleting consensus metadata
I20260812 00:24:43.269203 4332 catalog_manager.cc:4841] TS 15d2826f2c5c4c4bb867b9cb098eac08 (127.18.163.193:39689): tablet 1df43edc6c4a49b5a5270e2af52b67d8 (table test-table [id=8284dafe919343cc81fa1ef594cc41fa]) successfully deleted
I20260812 00:24:43.270961 4889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:43.231299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44046 (local address 127.18.163.193:39689)
0812 00:24:43.231552 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:43.231561 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:43.238466 (+ 6905us) server_negotiation.cc:407] Connection header received
0812 00:24:43.238827 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:43.238836 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:43.238984 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:43.239146 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:43.244951 (+ 5805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:43.246996 (+ 2045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:43.250523 (+ 3527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:43.251647 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:43.251814 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:43.261987 (+ 10173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:43.262007 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:43.262032 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:43.262103 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:43.267451 (+ 5348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:43.268376 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:43.268387 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:43.268390 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:43.268576 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:43.269082 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:43.269091 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:43.269095 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:43.269560 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:43.269945 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:43.270310 (+ 365us) server_negotiation.cc:299] Negotiation successful
0812 00:24:43.270574 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 00:24:43.271749 4552 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:43.377480 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 4415
I20260812 00:24:43.403812 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 4563
Aug 12 00:24:43 dist-test-slave-njxd krb5kdc[4296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
I20260812 00:24:43.424485 4885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:43.404678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38684 (local address 127.18.163.194:36151)
0812 00:24:43.404891 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:43.404896 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:43.404915 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:24:43.405062 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:43.405066 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:43.405144 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:43.405242 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:43.406750 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:43.407560 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:43.409074 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:43.409487 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:43.409684 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:43.418151 (+ 8467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:43.418174 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:43.418192 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:43.418247 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:43.421267 (+ 3020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:43.422262 (+ 995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:43.422271 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:43.422274 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:43.422443 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:43.422847 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:43.422850 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:43.422852 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:43.423315 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:43.423571 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:43.423901 (+ 330us) server_negotiation.cc:299] Negotiation successful
0812 00:24:43.424097 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 00:24:43.425266 4702 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:43.524081 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 4563
I20260812 00:24:43.548182 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 4717
Aug 12 00:24:43 dist-test-slave-njxd krb5kdc[4296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:24:43.564672 4891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:24:43.549059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54506 (local address 127.18.163.195:33817)
0812 00:24:43.549285 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 00:24:43.549290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:24:43.549310 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:24:43.549443 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:24:43.549447 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:24:43.549513 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:24:43.549657 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:24:43.551084 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:43.551835 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:43.553202 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:24:43.553669 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:24:43.553781 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:24:43.558639 (+ 4858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:24:43.558659 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:24:43.558676 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:24:43.558738 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:24:43.561543 (+ 2805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:43.562455 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:43.562463 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:43.562465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:43.562661 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:24:43.563027 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:24:43.563031 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:24:43.563033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:24:43.563558 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:24:43.563844 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0812 00:24:43.564194 (+ 350us) server_negotiation.cc:299] Negotiation successful
0812 00:24:43.564380 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260812 00:24:43.565428 4863 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:43.659313 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 4717
I20260812 00:24:43.684827 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 4311
I20260812 00:24:43.686153 4381 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:24:43.803648 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 4311
I20260812 00:25:03.832264 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:34895
--webserver_interface=127.18.163.254
--webserver_port=40345
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:34895
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:25:04.205560 4927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:04.206022 4927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:04.206187 4927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:04.213879 4927 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 00:25:04.213995 4927 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 00:25:04.214063 4927 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 00:25:04.214144 4927 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:25:04.214237 4927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:04.214347 4927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:04.214437 4927 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:25:04.214520 4927 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:25:04.225189 4927 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:34895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:34895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=40345
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:04.226711 4927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:04.228223 4927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:04.256750 4935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:04.256712 4937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:04.257023 4933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:04.257411 4927 server_base.cc:1034] running on GCE node
I20260812 00:25:04.258699 4927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:04.260612 4927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:04.261895 4927 hybrid_clock.cc:648] HybridClock initialized: now 1786494304261821 us; error 69 us; skew 500 ppm
I20260812 00:25:04.262364 4927 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:25:04 dist-test-slave-njxd krb5kdc[4296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494304, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:25:04.266630 4927 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:25:04.268616 4927 webserver.cc:460] Webserver started at http://127.18.163.254:40345/ using document root <none> and password file <none>
I20260812 00:25:04.269549 4927 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:04.269785 4927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:04.276957 4927 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 00:25:04.280714 4944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:04.282404 4927 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 00:25:04.282639 4927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "b1868512160a4ce1aacf868ba0fa8467"
format_stamp: "Formatted at 2026-08-12 00:24:40 on dist-test-slave-njxd"
server_key: "c9edee1444a3008f8de2affca6534955"
server_key_iv: "f79b18fda95908377b2549d4e56bf59c"
server_key_version: "encryptionkey@0"
I20260812 00:25:04.283828 4927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:04.303407 4927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:04.308219 4927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:04.308569 4927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:04.330222 4927 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:34895
I20260812 00:25:04.330253 5003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:34895 every 8 connection(s)
I20260812 00:25:04.332072 4927 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:25:04.339821 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 4927
I20260812 00:25:04.340646 5004 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:25:04.340868 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:39689
--local_ip_for_outbound_sockets=127.18.163.193
--tserver_master_addrs=127.18.163.254:34895
--webserver_port=44849
--webserver_interface=127.18.163.193
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:25:04.344657 5004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Bootstrap starting.
I20260812 00:25:04.367024 5004 log.cc:824] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Log is configured to *not* fsync() on all Append() calls
I20260812 00:25:04.380962 5004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:25:04.381652 5004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Bootstrap complete.
I20260812 00:25:04.391963 5004 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } }
I20260812 00:25:04.392946 5004 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1868512160a4ce1aacf868ba0fa8467, State: Initialized, Role: FOLLOWER
I20260812 00:25:04.393679 5004 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } }
I20260812 00:25:04.393968 5004 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:25:04.394114 5004 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:25:04.394305 5004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:25:04.398811 5004 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } }
I20260812 00:25:04.399461 5004 leader_election.cc:302] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1868512160a4ce1aacf868ba0fa8467; no voters:
I20260812 00:25:04.400229 5004 leader_election.cc:288] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:25:04.400406 5012 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:25:04.401794 5012 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 2 LEADER]: Becoming Leader. State: Replica: b1868512160a4ce1aacf868ba0fa8467, State: Running, Role: LEADER
I20260812 00:25:04.402594 5012 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } }
I20260812 00:25:04.403036 5004 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:25:04.405967 5016 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1868512160a4ce1aacf868ba0fa8467. Latest consensus state: current_term: 2 leader_uuid: "b1868512160a4ce1aacf868ba0fa8467" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } } }
I20260812 00:25:04.406524 5016 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [sys.catalog]: This master's current role is: LEADER
I20260812 00:25:04.407183 5013 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b1868512160a4ce1aacf868ba0fa8467" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } } }
I20260812 00:25:04.407660 5013 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [sys.catalog]: This master's current role is: LEADER
I20260812 00:25:04.408528 5023 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:25:04.430881 5023 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:25:04.433240 5023 catalog_manager.cc:1259] Loaded cluster ID: fe9ee7849fa048b9a9f684079faa2b01
I20260812 00:25:04.433514 5023 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:25:04.439455 5023 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:25:04.441972 5023 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Loaded TSK: 0
I20260812 00:25:04.476061 5023 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Generated new TSK 1
I20260812 00:25:04.476532 5023 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:25:04.755574 5009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:04.755956 5009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:04.756125 5009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:04.764137 5009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:04.764335 5009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:04.764523 5009 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:25:04.775321 5009 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:39689
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=44849
--tserver_master_addrs=127.18.163.254:34895
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:04.776841 5009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:04.778656 5009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:04.795337 5040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:04.795398 5038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:04.796069 5037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:04.796694 5009 server_base.cc:1034] running on GCE node
I20260812 00:25:04.797458 5009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:04.798720 5009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:04.799973 5009 hybrid_clock.cc:648] HybridClock initialized: now 1786494304799897 us; error 69 us; skew 500 ppm
I20260812 00:25:04.800361 5009 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:25:04 dist-test-slave-njxd krb5kdc[4296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494304, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:25:04.804512 5009 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:25:04.806617 5009 webserver.cc:460] Webserver started at http://127.18.163.193:44849/ using document root <none> and password file <none>
I20260812 00:25:04.807395 5009 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:04.807583 5009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:04.814002 5009 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 00:25:04.817301 5050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:04.819087 5009 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:25:04.819298 5009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "15d2826f2c5c4c4bb867b9cb098eac08"
format_stamp: "Formatted at 2026-08-12 00:24:41 on dist-test-slave-njxd"
server_key: "6ceef411ce40041cf038c9dfea3fa5fd"
server_key_iv: "01c449ac2be8ca0dcd31657a944ae513"
server_key_version: "encryptionkey@0"
I20260812 00:25:04.820429 5009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:04.850119 5009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:04.855208 5009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:04.855523 5009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:04.856621 5009 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:25:04.858151 5009 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:25:04.858292 5009 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:04.858429 5009 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:25:04.858537 5009 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:04.894917 5009 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:39689
I20260812 00:25:04.895018 5175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:39689 every 8 connection(s)
I20260812 00:25:04.896555 5009 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:25:04.899317 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 5009
I20260812 00:25:04.900307 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:36151
--local_ip_for_outbound_sockets=127.18.163.194
--tserver_master_addrs=127.18.163.254:34895
--webserver_port=36847
--webserver_interface=127.18.163.194
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:25:04 dist-test-slave-njxd krb5kdc[4296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494304, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:25:04.927719 5179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:04.900033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:44683)
0812 00:25:04.901323 (+ 1290us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:04.901388 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:04.904338 (+ 2950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:04.906105 (+ 1767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:04.906120 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:04.907026 (+ 906us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:25:04.907936 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:04.907970 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:04.909819 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:04.909829 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:04.912038 (+ 2209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:04.912058 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:04.913341 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:04.913351 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:04.913725 (+ 374us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:04.914674 (+ 949us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:25:04.914721 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:25:04.917474 (+ 2753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:25:04.922858 (+ 5384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:04.922867 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:04.922880 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:04.923402 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:04.924075 (+ 673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:04.924079 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:04.924081 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:04.924319 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:04.925440 (+ 1121us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:25:04.925447 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:25:04.925884 (+ 437us) client_negotiation.cc:769] Sending connection context
0812 00:25:04.926149 (+ 265us) client_negotiation.cc:240] Negotiation successful
0812 00:25:04.926612 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":949,"thread_start_us":660,"threads_started":1}
I20260812 00:25:04.928300 5178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:04.899865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:44683 (local address 127.18.163.254:34895)
0812 00:25:04.900643 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:04.900666 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:04.901566 (+ 900us) server_negotiation.cc:407] Connection header received
0812 00:25:04.905034 (+ 3468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:04.905058 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:04.905453 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:04.905879 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:04.908238 (+ 2359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:04.909549 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:04.912246 (+ 2697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:04.913075 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:04.913237 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:04.917932 (+ 4695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:04.917947 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:04.917973 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:04.918035 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:04.922630 (+ 4595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:04.923602 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:04.923618 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:04.923663 (+ 45us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:04.923933 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:04.924436 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:04.924444 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:04.924449 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:04.925252 (+ 803us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:04.925475 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:04.926436 (+ 961us) server_negotiation.cc:299] Negotiation successful
0812 00:25:04.926939 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":326,"threads_started":1}
I20260812 00:25:04.931257 5176 heartbeater.cc:347] Connected to a master server at 127.18.163.254:34895
I20260812 00:25:04.931651 5176 heartbeater.cc:464] Registering TS with master...
I20260812 00:25:04.932659 5176 heartbeater.cc:511] Master 127.18.163.254:34895 requested a full tablet report, sending...
I20260812 00:25:04.935283 4963 ts_manager.cc:194] Registered new tserver with Master: 15d2826f2c5c4c4bb867b9cb098eac08 (127.18.163.193:39689)
I20260812 00:25:04.936949 4963 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:44683
W20260812 00:25:05.283468 5180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:05.283846 5180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:05.284029 5180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:05.291930 5180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:05.292111 5180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:05.292308 5180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:25:05.302659 5180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:36151
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=36847
--tserver_master_addrs=127.18.163.254:34895
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:05.304484 5180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:05.306205 5180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:05.320470 5186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:05.320581 5187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:05.320780 5189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:05.321641 5180 server_base.cc:1034] running on GCE node
I20260812 00:25:05.322300 5180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:05.323295 5180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:05.324517 5180 hybrid_clock.cc:648] HybridClock initialized: now 1786494305324470 us; error 42 us; skew 500 ppm
I20260812 00:25:05.324934 5180 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:25:05 dist-test-slave-njxd krb5kdc[4296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494305, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:25:05.328415 5180 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:25:05.330293 5180 webserver.cc:460] Webserver started at http://127.18.163.194:36847/ using document root <none> and password file <none>
I20260812 00:25:05.331077 5180 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:05.331251 5180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:05.337255 5180 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 00:25:05.340430 5198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:05.342197 5180 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:25:05.342404 5180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "9753bf9f35e943aaa22e12fab2f7e530"
format_stamp: "Formatted at 2026-08-12 00:24:42 on dist-test-slave-njxd"
server_key: "de6fbc51bb08907850ca7a2758f453ed"
server_key_iv: "36cd54961b2092aef711b37e1edcf89b"
server_key_version: "encryptionkey@0"
I20260812 00:25:05.343492 5180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:05.375213 5180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:05.380286 5180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:05.380656 5180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:05.381850 5180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:25:05.383350 5180 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:25:05.383474 5180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:05.383625 5180 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:25:05.383728 5180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:05.421012 5180 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:36151
I20260812 00:25:05.421087 5325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:36151 every 8 connection(s)
I20260812 00:25:05.422708 5180 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:25:05.423432 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 5180
I20260812 00:25:05.424319 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:33817
--local_ip_for_outbound_sockets=127.18.163.195
--tserver_master_addrs=127.18.163.254:34895
--webserver_port=39697
--webserver_interface=127.18.163.195
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:25:05 dist-test-slave-njxd krb5kdc[4296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494305, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:25:05.448609 5178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:05.425866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:39515 (local address 127.18.163.254:34895)
0812 00:25:05.426103 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:05.426109 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:05.427490 (+ 1381us) server_negotiation.cc:407] Connection header received
0812 00:25:05.430629 (+ 3139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:05.430634 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:05.430750 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:05.430851 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:05.433256 (+ 2405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:05.434078 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:05.436793 (+ 2715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:05.437279 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:05.437398 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:05.442203 (+ 4805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:05.442209 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:05.442213 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:05.442260 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:05.445033 (+ 2773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:05.446021 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:05.446034 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:05.446038 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:05.446182 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:05.446680 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:05.446684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:05.446686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:05.447007 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:05.447189 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:05.447962 (+ 773us) server_negotiation.cc:299] Negotiation successful
0812 00:25:05.448238 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 00:25:05.449759 5328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:05.426344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:39515)
0812 00:25:05.427269 (+ 925us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:05.427331 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:05.430239 (+ 2908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:05.431188 (+ 949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:05.431203 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:05.432077 (+ 874us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:25:05.433004 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:05.433035 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:05.434272 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:05.434280 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:05.436587 (+ 2307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:05.436609 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:05.437554 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:05.437564 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:05.437957 (+ 393us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:05.438817 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:25:05.438855 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:25:05.441895 (+ 3040us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:25:05.445250 (+ 3355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:05.445266 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:05.445283 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:05.445871 (+ 588us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:05.446313 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:05.446319 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:05.446322 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:05.446534 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:05.447153 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:25:05.447162 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:25:05.447571 (+ 409us) client_negotiation.cc:769] Sending connection context
0812 00:25:05.447853 (+ 282us) client_negotiation.cc:240] Negotiation successful
0812 00:25:05.448459 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":345,"threads_started":1}
I20260812 00:25:05.451546 5326 heartbeater.cc:347] Connected to a master server at 127.18.163.254:34895
I20260812 00:25:05.451900 5326 heartbeater.cc:464] Registering TS with master...
I20260812 00:25:05.452800 5326 heartbeater.cc:511] Master 127.18.163.254:34895 requested a full tablet report, sending...
I20260812 00:25:05.454583 4963 ts_manager.cc:194] Registered new tserver with Master: 9753bf9f35e943aaa22e12fab2f7e530 (127.18.163.194:36151)
I20260812 00:25:05.455773 4963 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:39515
W20260812 00:25:05.810101 5329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:05.810494 5329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:05.810750 5329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:05.818813 5329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:05.819001 5329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:05.819206 5329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:25:05.830083 5329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:33817
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=39697
--tserver_master_addrs=127.18.163.254:34895
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:05.831609 5329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:05.833071 5329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:05.847800 5338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:05.847872 5341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:05.847790 5339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:05.849357 5329 server_base.cc:1034] running on GCE node
I20260812 00:25:05.850137 5329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:05.851238 5329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:05.852490 5329 hybrid_clock.cc:648] HybridClock initialized: now 1786494305852449 us; error 56 us; skew 500 ppm
I20260812 00:25:05.852849 5329 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:25:05 dist-test-slave-njxd krb5kdc[4296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494305, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:25:05.862095 5329 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:25:05.863911 5329 webserver.cc:460] Webserver started at http://127.18.163.195:39697/ using document root <none> and password file <none>
I20260812 00:25:05.864670 5329 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:05.864807 5329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:05.871057 5329 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 00:25:05.874207 5349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:05.875778 5329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260812 00:25:05.876003 5329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167"
format_stamp: "Formatted at 2026-08-12 00:24:42 on dist-test-slave-njxd"
server_key: "8a6c7527b8cb21d960e400163e50558a"
server_key_iv: "7876f1523a2a618ebca8ceb4e4bb76a6"
server_key_version: "encryptionkey@0"
I20260812 00:25:05.877130 5329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:05.890738 5329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:05.895833 5329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:05.896157 5329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:05.897401 5329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:25:05.899102 5329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:25:05.899209 5329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:05.899374 5329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:25:05.899441 5329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:05.939814 5329 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:33817
I20260812 00:25:05.939867 5479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:33817 every 8 connection(s)
I20260812 00:25:05.941424 5329 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:25:05.941488 5176 heartbeater.cc:503] Master 127.18.163.254:34895 was elected leader, sending a full tablet report...
I20260812 00:25:05.944036 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 5329
Aug 12 00:25:05 dist-test-slave-njxd krb5kdc[4296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494305, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:25:05.963109 5482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:05.944981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57950 (local address 127.18.163.254:34895)
0812 00:25:05.945452 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:05.945458 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:05.946202 (+ 744us) server_negotiation.cc:407] Connection header received
0812 00:25:05.946431 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:05.946437 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:05.946519 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:05.946649 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:05.948802 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:05.949665 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:05.951676 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:05.952458 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:05.952604 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:05.956272 (+ 3668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:05.956280 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:05.956285 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:05.956322 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:05.959552 (+ 3230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:05.960465 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:05.960471 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:05.960476 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:05.960656 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:05.961131 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:05.961139 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:05.961148 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:05.961607 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:05.961887 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:05.962322 (+ 435us) server_negotiation.cc:299] Negotiation successful
0812 00:25:05.962597 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":380,"thread_start_us":266,"threads_started":1}
I20260812 00:25:05.967599 5178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:05.944835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:37957 (local address 127.18.163.254:34895)
0812 00:25:05.945062 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:05.945068 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:05.946280 (+ 1212us) server_negotiation.cc:407] Connection header received
0812 00:25:05.949249 (+ 2969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:05.949254 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:05.949345 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:05.949467 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:05.951703 (+ 2236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:05.952845 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:05.955493 (+ 2648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:05.955960 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:05.956064 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:05.960029 (+ 3965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:05.960034 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:05.960037 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:05.960071 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:05.963581 (+ 3510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:05.964700 (+ 1119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:05.964705 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:05.964709 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:05.964874 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:05.965481 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:05.965486 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:05.965489 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:05.965882 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:05.966035 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:05.967141 (+ 1106us) server_negotiation.cc:299] Negotiation successful
0812 00:25:05.967334 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":105}
I20260812 00:25:05.968734 5483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:05.944954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:37957)
0812 00:25:05.946098 (+ 1144us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:05.946152 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:05.948965 (+ 2813us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:05.949813 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:05.949826 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:05.950661 (+ 835us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:25:05.951530 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:05.951558 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:05.953026 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:05.953033 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:05.955302 (+ 2269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:05.955323 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:05.956241 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:05.956247 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:05.956465 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:05.957099 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:25:05.957123 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:25:05.959771 (+ 2648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:25:05.963776 (+ 4005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:05.963784 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:05.963799 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:05.964546 (+ 747us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:05.965000 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:05.965006 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:05.965009 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:05.965247 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:05.966033 (+ 786us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:25:05.966041 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:25:05.966521 (+ 480us) client_negotiation.cc:769] Sending connection context
0812 00:25:05.967021 (+ 500us) client_negotiation.cc:240] Negotiation successful
0812 00:25:05.967488 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":706,"thread_start_us":447,"threads_started":1}
I20260812 00:25:05.970261 5480 heartbeater.cc:347] Connected to a master server at 127.18.163.254:34895
I20260812 00:25:05.970611 5480 heartbeater.cc:464] Registering TS with master...
I20260812 00:25:05.971382 5480 heartbeater.cc:511] Master 127.18.163.254:34895 requested a full tablet report, sending...
I20260812 00:25:05.972958 4963 ts_manager.cc:194] Registered new tserver with Master: 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817)
I20260812 00:25:05.973925 4963 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:37957
I20260812 00:25:05.979085 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:25:05.986423 5178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:05.980076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57966 (local address 127.18.163.254:34895)
0812 00:25:05.980268 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:05.980272 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:05.981063 (+ 791us) server_negotiation.cc:407] Connection header received
0812 00:25:05.981276 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:05.981280 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:05.981433 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:05.981619 (+ 186us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:25:05.982059 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:05.982853 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:05.984494 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:05.984918 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:05.985013 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:05.985522 (+ 509us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:25:05.985882 (+ 360us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 00:25:05.986204 (+ 322us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57966: token expired
Metrics: {"server-negotiator.queue_time_us":69}
W20260812 00:25:05.986588 5178 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57966: token expired
W20260812 00:25:05.987198 4874 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.18.163.254:34895)
I20260812 00:25:06.001835 5178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:05.987929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57980 (local address 127.18.163.254:34895)
0812 00:25:05.988115 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:05.988122 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:05.988143 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:25:05.988360 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:05.988365 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:05.988457 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:05.988581 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:05.990240 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:05.991004 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:05.992417 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:05.992867 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:05.993005 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:05.996120 (+ 3115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:05.996126 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:05.996130 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:05.996172 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:05.998765 (+ 2593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:05.999553 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:05.999560 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:05.999563 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:05.999710 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:06.000140 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:06.000145 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:06.000149 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:06.000516 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:06.000795 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:06.001165 (+ 370us) server_negotiation.cc:299] Negotiation successful
0812 00:25:06.001436 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 00:25:06.006099 4963 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57980:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:25:06.014592 4963 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:25:06.053946 5493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.028142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:36151 (local address 127.0.0.1:57798)
0812 00:25:06.043539 (+ 15397us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:06.043571 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:06.043762 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:06.045671 (+ 1909us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:06.045676 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:06.045704 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:06.046128 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:06.046142 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.048101 (+ 1959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.048106 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:06.050904 (+ 2798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:06.050924 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.052816 (+ 1892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.052823 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:06.053019 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:06.053071 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 00:25:06.053219 (+ 148us) client_negotiation.cc:240] Negotiation successful
0812 00:25:06.053474 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15203,"thread_start_us":15734,"threads_started":1}
I20260812 00:25:06.054301 5495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.028724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57798 (local address 127.18.163.194:36151)
0812 00:25:06.044753 (+ 16029us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:06.044762 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:06.044792 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:25:06.044895 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:06.044903 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:06.045164 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:06.045381 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:06.046334 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.047875 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.051166 (+ 3291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.052581 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.052797 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:06.052988 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:06.053730 (+ 742us) server_negotiation.cc:299] Negotiation successful
0812 00:25:06.053942 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15844,"thread_start_us":15669,"threads_started":1}
I20260812 00:25:06.054883 5492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.027974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:39689 (local address 127.0.0.1:42210)
0812 00:25:06.042315 (+ 14341us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:06.042388 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:06.042693 (+ 305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:06.045052 (+ 2359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:06.045060 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:06.045089 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:06.045659 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:06.045672 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.049323 (+ 3651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.049328 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:06.051652 (+ 2324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:06.051668 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.054186 (+ 2518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.054192 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:06.054370 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:06.054424 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 00:25:06.054512 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 00:25:06.054635 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13906,"thread_start_us":14978,"threads_started":1}
I20260812 00:25:06.055117 5494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.028204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42210 (local address 127.18.163.193:39689)
0812 00:25:06.043502 (+ 15298us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:06.043512 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:06.043550 (+ 38us) server_negotiation.cc:407] Connection header received
0812 00:25:06.043657 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:06.043665 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:06.043931 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:06.044842 (+ 911us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:06.045925 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.049142 (+ 3217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.051988 (+ 2846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.053531 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.053802 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:06.053980 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:06.054622 (+ 642us) server_negotiation.cc:299] Negotiation successful
0812 00:25:06.054797 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15078,"thread_start_us":15805,"threads_started":1}
I20260812 00:25:06.058558 5253 tablet_service.cc:1467] Processing CreateTablet for tablet f142464ff20b43cea2c6051a864e6576 (DEFAULT_TABLE table=test-table [id=6fb081f595a24548a4464ee51f5196fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:25:06.058620 5103 tablet_service.cc:1467] Processing CreateTablet for tablet f142464ff20b43cea2c6051a864e6576 (DEFAULT_TABLE table=test-table [id=6fb081f595a24548a4464ee51f5196fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:25:06.060201 5103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f142464ff20b43cea2c6051a864e6576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:25:06.060249 5497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.045322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:33817 (local address 127.0.0.1:37320)
0812 00:25:06.049164 (+ 3842us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:06.049179 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:06.049338 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:06.050033 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:06.050039 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:06.050065 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:06.050523 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:06.050536 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.053379 (+ 2843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.053384 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:06.057215 (+ 3831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:06.057251 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.059298 (+ 2047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.059306 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:06.059508 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:06.059545 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 00:25:06.059670 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 00:25:06.059850 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3702,"thread_start_us":3525,"threads_started":1}
I20260812 00:25:06.060282 5253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f142464ff20b43cea2c6051a864e6576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:25:06.060316 5496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.044738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37320 (local address 127.18.163.195:33817)
0812 00:25:06.048832 (+ 4094us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:06.048842 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:06.049365 (+ 523us) server_negotiation.cc:407] Connection header received
0812 00:25:06.049486 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:06.049497 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:06.049815 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:06.050022 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:06.050801 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.053174 (+ 2373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.057456 (+ 4282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.059004 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.059244 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:06.059440 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:06.059735 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 00:25:06.059930 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3883,"thread_start_us":3702,"threads_started":1}
I20260812 00:25:06.064692 5405 tablet_service.cc:1467] Processing CreateTablet for tablet f142464ff20b43cea2c6051a864e6576 (DEFAULT_TABLE table=test-table [id=6fb081f595a24548a4464ee51f5196fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:25:06.066473 5405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f142464ff20b43cea2c6051a864e6576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:25:06.074393 5498 tablet_bootstrap.cc:492] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530: Bootstrap starting.
I20260812 00:25:06.079289 5499 tablet_bootstrap.cc:492] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08: Bootstrap starting.
I20260812 00:25:06.080307 5498 tablet_bootstrap.cc:654] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530: Neither blocks nor log segments found. Creating new log.
I20260812 00:25:06.082124 5498 log.cc:824] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530: Log is configured to *not* fsync() on all Append() calls
I20260812 00:25:06.083693 5499 tablet_bootstrap.cc:654] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08: Neither blocks nor log segments found. Creating new log.
I20260812 00:25:06.085192 5499 log.cc:824] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08: Log is configured to *not* fsync() on all Append() calls
I20260812 00:25:06.086232 5498 tablet_bootstrap.cc:492] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530: No bootstrap required, opened a new log
I20260812 00:25:06.086534 5498 ts_tablet_manager.cc:1397] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.005s
I20260812 00:25:06.088856 5499 tablet_bootstrap.cc:492] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08: No bootstrap required, opened a new log
I20260812 00:25:06.088967 5501 tablet_bootstrap.cc:492] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Bootstrap starting.
I20260812 00:25:06.089169 5499 ts_tablet_manager.cc:1397] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260812 00:25:06.092286 5501 tablet_bootstrap.cc:654] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Neither blocks nor log segments found. Creating new log.
I20260812 00:25:06.093441 5501 log.cc:824] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Log is configured to *not* fsync() on all Append() calls
I20260812 00:25:06.096480 5501 tablet_bootstrap.cc:492] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167: No bootstrap required, opened a new log
I20260812 00:25:06.096802 5501 ts_tablet_manager.cc:1397] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260812 00:25:06.097967 5498 raft_consensus.cc:348] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:25:06.098474 5498 raft_consensus.cc:374] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:25:06.098564 5498 raft_consensus.cc:729] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9753bf9f35e943aaa22e12fab2f7e530, State: Initialized, Role: FOLLOWER
I20260812 00:25:06.099454 5498 consensus_queue.cc:260] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:25:06.101058 5326 heartbeater.cc:503] Master 127.18.163.254:34895 was elected leader, sending a full tablet report...
I20260812 00:25:06.100548 5499 raft_consensus.cc:348] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:25:06.101784 5498 ts_tablet_manager.cc:1428] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530: Time spent starting tablet: real 0.015s user 0.014s sys 0.002s
I20260812 00:25:06.102022 5499 raft_consensus.cc:374] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:25:06.102156 5499 raft_consensus.cc:729] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15d2826f2c5c4c4bb867b9cb098eac08, State: Initialized, Role: FOLLOWER
I20260812 00:25:06.102859 5499 consensus_queue.cc:260] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:25:06.104847 5499 ts_tablet_manager.cc:1428] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08: Time spent starting tablet: real 0.016s user 0.010s sys 0.005s
I20260812 00:25:06.107709 5501 raft_consensus.cc:348] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:25:06.108240 5501 raft_consensus.cc:374] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:25:06.108382 5501 raft_consensus.cc:729] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 322f0f3aae3d4ac6b67d8e3e7ce56167, State: Initialized, Role: FOLLOWER
I20260812 00:25:06.109071 5501 consensus_queue.cc:260] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:25:06.110287 5480 heartbeater.cc:503] Master 127.18.163.254:34895 was elected leader, sending a full tablet report...
I20260812 00:25:06.110839 5501 ts_tablet_manager.cc:1428] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
W20260812 00:25:06.149240 5177 tablet.cc:2369] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:25:06.175143 5327 tablet.cc:2369] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:25:06.193348 5481 tablet.cc:2369] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:25:06.229046 5504 raft_consensus.cc:482] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:25:06.229439 5504 raft_consensus.cc:504] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:25:06.231341 5504 leader_election.cc:288] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15d2826f2c5c4c4bb867b9cb098eac08 (127.18.163.193:39689), 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817)
I20260812 00:25:06.239044 5494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.231901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:36939 (local address 127.18.163.193:39689)
0812 00:25:06.232179 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:06.232188 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:06.233232 (+ 1044us) server_negotiation.cc:407] Connection header received
0812 00:25:06.233412 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:06.233415 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:06.233476 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:06.233626 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:06.234343 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.235084 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.237113 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.237983 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.238152 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:06.238264 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:06.238614 (+ 350us) server_negotiation.cc:299] Negotiation successful
0812 00:25:06.238755 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 00:25:06.239115 5496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.232080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:55689 (local address 127.18.163.195:33817)
0812 00:25:06.232354 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:06.232363 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:06.233062 (+ 699us) server_negotiation.cc:407] Connection header received
0812 00:25:06.233355 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:06.233360 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:06.233447 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:06.233518 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:06.234257 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.235036 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.237114 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.238026 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.238242 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:06.238322 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:06.238690 (+ 368us) server_negotiation.cc:299] Negotiation successful
0812 00:25:06.238831 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260812 00:25:06.239214 5507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.231696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:33817 (local address 127.18.163.194:55689)
0812 00:25:06.232914 (+ 1218us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:06.232931 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:06.233142 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:06.233595 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:06.233610 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:06.233637 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:06.234072 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:06.234086 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.235195 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.235202 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:06.236928 (+ 1726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:06.236942 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.238294 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.238301 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:06.238491 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:06.238515 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 00:25:06.238633 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 00:25:06.238777 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1077,"mutex_wait_us":107,"thread_start_us":701,"threads_started":1}
I20260812 00:25:06.239742 5508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.231780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:39689 (local address 127.18.163.194:36939)
0812 00:25:06.233109 (+ 1329us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:06.233124 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:06.233276 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:06.233661 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:06.233666 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:06.233694 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:06.234142 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:06.234181 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.235246 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.235249 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:06.236934 (+ 1685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:06.236947 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.238242 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.238250 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:06.238444 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:06.238470 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 00:25:06.238550 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 00:25:06.238706 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1205,"mutex_wait_us":30,"thread_start_us":977,"threads_started":1}
I20260812 00:25:06.240490 5430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f142464ff20b43cea2c6051a864e6576" candidate_uuid: "9753bf9f35e943aaa22e12fab2f7e530" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" is_pre_election: true
I20260812 00:25:06.240931 5124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f142464ff20b43cea2c6051a864e6576" candidate_uuid: "9753bf9f35e943aaa22e12fab2f7e530" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" is_pre_election: true
I20260812 00:25:06.241164 5430 raft_consensus.cc:2454] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9753bf9f35e943aaa22e12fab2f7e530 in term 0.
I20260812 00:25:06.241472 5124 raft_consensus.cc:2454] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9753bf9f35e943aaa22e12fab2f7e530 in term 0.
I20260812 00:25:06.242049 5199 leader_election.cc:302] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 322f0f3aae3d4ac6b67d8e3e7ce56167, 9753bf9f35e943aaa22e12fab2f7e530; no voters:
I20260812 00:25:06.242506 5504 raft_consensus.cc:2781] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:25:06.242717 5504 raft_consensus.cc:482] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:25:06.242852 5504 raft_consensus.cc:3037] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:25:06.245393 5504 raft_consensus.cc:504] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:25:06.246129 5504 leader_election.cc:288] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [CANDIDATE]: Term 1 election: Requested vote from peers 15d2826f2c5c4c4bb867b9cb098eac08 (127.18.163.193:39689), 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817)
I20260812 00:25:06.246841 5124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f142464ff20b43cea2c6051a864e6576" candidate_uuid: "9753bf9f35e943aaa22e12fab2f7e530" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15d2826f2c5c4c4bb867b9cb098eac08"
I20260812 00:25:06.246867 5430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f142464ff20b43cea2c6051a864e6576" candidate_uuid: "9753bf9f35e943aaa22e12fab2f7e530" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167"
I20260812 00:25:06.247124 5124 raft_consensus.cc:3037] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:25:06.247113 5430 raft_consensus.cc:3037] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:25:06.250648 5124 raft_consensus.cc:2454] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9753bf9f35e943aaa22e12fab2f7e530 in term 1.
I20260812 00:25:06.250648 5430 raft_consensus.cc:2454] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9753bf9f35e943aaa22e12fab2f7e530 in term 1.
I20260812 00:25:06.251243 5199 leader_election.cc:302] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 15d2826f2c5c4c4bb867b9cb098eac08, 322f0f3aae3d4ac6b67d8e3e7ce56167, 9753bf9f35e943aaa22e12fab2f7e530; no voters:
I20260812 00:25:06.251681 5504 raft_consensus.cc:2781] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:25:06.252177 5504 raft_consensus.cc:686] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [term 1 LEADER]: Becoming Leader. State: Replica: 9753bf9f35e943aaa22e12fab2f7e530, State: Running, Role: LEADER
I20260812 00:25:06.252787 5504 consensus_queue.cc:237] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:25:06.258926 4962 catalog_manager.cc:5495] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9753bf9f35e943aaa22e12fab2f7e530 (127.18.163.194). New cstate: current_term: 1 leader_uuid: "9753bf9f35e943aaa22e12fab2f7e530" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } health_report { overall_health: UNKNOWN } } }
I20260812 00:25:06.301693 5495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.295654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57810 (local address 127.18.163.194:36151)
0812 00:25:06.295859 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:06.295864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:06.295883 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:25:06.296075 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:06.296079 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:06.296163 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:06.296305 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:25:06.296624 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.297380 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.299030 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.299453 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.299552 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:06.300247 (+ 695us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:25:06.300802 (+ 555us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:25:06.300929 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:06.301217 (+ 288us) server_negotiation.cc:299] Negotiation successful
0812 00:25:06.301305 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 00:25:06.311048 5430 raft_consensus.cc:1261] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 1 FOLLOWER]: Refusing update from remote peer 9753bf9f35e943aaa22e12fab2f7e530: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:25:06.311060 5124 raft_consensus.cc:1261] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Refusing update from remote peer 9753bf9f35e943aaa22e12fab2f7e530: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:25:06.312300 5504 consensus_queue.cc:1035] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:25:06.312665 5509 consensus_queue.cc:1035] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [LEADER]: Connected to new peer: Peer: permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:25:06.332643 5513 mvcc.cc:205] Tried to move back new op lower bound from 7317480678638428160 to 7317480678416027648. Current Snapshot: MvccSnapshot[applied={T|T < 7317480678638428160}]
I20260812 00:25:06.353454 4962 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:25:06.353883 4962 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:25:06.358381 4962 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Sending DeleteTablet for 3 replicas of tablet f142464ff20b43cea2c6051a864e6576
I20260812 00:25:06.359817 5103 tablet_service.cc:1514] Processing DeleteTablet for tablet f142464ff20b43cea2c6051a864e6576 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:25:06 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:42210
I20260812 00:25:06.359871 5253 tablet_service.cc:1514] Processing DeleteTablet for tablet f142464ff20b43cea2c6051a864e6576 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:25:06 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:57798
I20260812 00:25:06.360278 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 5009
I20260812 00:25:06.360946 5405 tablet_service.cc:1514] Processing DeleteTablet for tablet f142464ff20b43cea2c6051a864e6576 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:25:06 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:37320
I20260812 00:25:06.387293 5494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.361758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42220 (local address 127.18.163.193:39689)
0812 00:25:06.361979 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:06.361988 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:06.362390 (+ 402us) server_negotiation.cc:407] Connection header received
0812 00:25:06.362468 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:06.362476 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:06.362577 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:06.362678 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:06.365393 (+ 2715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.366957 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.369637 (+ 2680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.370564 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.370721 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:06.375551 (+ 4830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:06.375581 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:06.375613 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:06.375691 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:06.381342 (+ 5651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:06.382746 (+ 1404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:06.382759 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:06.382764 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:06.383010 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:06.383582 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:06.383589 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:06.383595 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:06.384235 (+ 640us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:06.384616 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:06.386324 (+ 1708us) server_negotiation.cc:299] Negotiation successful
0812 00:25:06.386671 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:25:06.388036 5527 tablet_replica.cc:330] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167: stopping tablet replica
I20260812 00:25:06.388797 5527 raft_consensus.cc:2229] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:25:06.388861 5169 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:06.389372 5525 tablet_replica.cc:330] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530: stopping tablet replica
I20260812 00:25:06.389436 5527 raft_consensus.cc:2258] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:25:06.390455 5525 raft_consensus.cc:2229] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:25:06.391229 5525 raft_consensus.cc:2258] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:25:06.391921 5527 ts_tablet_manager.cc:1905] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:25:06.393520 5525 ts_tablet_manager.cc:1905] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:25:06.399613 5527 ts_tablet_manager.cc:1918] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:25:06.399859 5527 log.cc:1196] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/f142464ff20b43cea2c6051a864e6576
I20260812 00:25:06.400487 5527 ts_tablet_manager.cc:1939] T f142464ff20b43cea2c6051a864e6576 P 322f0f3aae3d4ac6b67d8e3e7ce56167: Deleting consensus metadata
I20260812 00:25:06.403637 5525 ts_tablet_manager.cc:1918] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:25:06.403637 4945 catalog_manager.cc:4841] TS 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817): tablet f142464ff20b43cea2c6051a864e6576 (table test-table [id=6fb081f595a24548a4464ee51f5196fd]) successfully deleted
I20260812 00:25:06.404014 5525 log.cc:1196] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/f142464ff20b43cea2c6051a864e6576
I20260812 00:25:06.404814 5525 ts_tablet_manager.cc:1939] T f142464ff20b43cea2c6051a864e6576 P 9753bf9f35e943aaa22e12fab2f7e530: Deleting consensus metadata
I20260812 00:25:06.406912 4945 catalog_manager.cc:4841] TS 9753bf9f35e943aaa22e12fab2f7e530 (127.18.163.194:36151): tablet f142464ff20b43cea2c6051a864e6576 (table test-table [id=6fb081f595a24548a4464ee51f5196fd]) successfully deleted
I20260812 00:25:06.497292 5524 tablet_replica.cc:330] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08: stopping tablet replica
I20260812 00:25:06.497885 5524 raft_consensus.cc:2229] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:25:06.497956 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 5009
W20260812 00:25:06.524431 4947 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.163.193:39689 (error 108)
I20260812 00:25:06.524760 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 5180
I20260812 00:25:06.526612 5497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.526038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:39689 (local address 127.0.0.1:42226)
0812 00:25:06.526300 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:06.526427 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:39689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
W20260812 00:25:06.526903 4947 catalog_manager.cc:4584] TS 15d2826f2c5c4c4bb867b9cb098eac08 (127.18.163.193:39689): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f142464ff20b43cea2c6051a864e6576: Network error: Client connection negotiation failed: client connection to 127.18.163.193:39689: connect: Connection refused (error 111)
I20260812 00:25:06.541136 5495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.525736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57820 (local address 127.18.163.194:36151)
0812 00:25:06.525965 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:06.525971 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:06.526051 (+ 80us) server_negotiation.cc:407] Connection header received
0812 00:25:06.526292 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:06.526299 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:06.526374 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:06.526498 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:06.528146 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.529007 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.530590 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.531081 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.531236 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:06.534231 (+ 2995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:06.534248 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:06.534272 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:06.534319 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:06.537729 (+ 3410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:06.538629 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:06.538638 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:06.538640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:06.538813 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:06.539256 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:06.539260 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:06.539262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:06.539663 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:06.540067 (+ 404us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:06.540406 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 00:25:06.540671 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:25:06.542178 5321 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:06.580614 5497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.580088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:39689 (local address 127.0.0.1:42234)
0812 00:25:06.580335 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:06.580461 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:39689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260812 00:25:06.581933 5497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.581413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:39689 (local address 127.0.0.1:42242)
0812 00:25:06.581641 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:06.581744 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:39689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260812 00:25:06.642807 5497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.642157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:39689 (local address 127.0.0.1:42250)
0812 00:25:06.642446 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:06.642572 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:39689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260812 00:25:06.644073 5497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.643627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:39689 (local address 127.0.0.1:42256)
0812 00:25:06.643810 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:06.643907 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:39689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 00:25:06.661788 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 5180
I20260812 00:25:06.688988 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 5329
I20260812 00:25:06.703383 5496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.689826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37330 (local address 127.18.163.195:33817)
0812 00:25:06.690028 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:06.690033 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:06.690052 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:25:06.690223 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:06.690227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:06.690303 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:06.690387 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:06.691813 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.692547 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.694218 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:06.694668 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:06.694769 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:06.697441 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:06.697457 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:06.697474 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:06.697534 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:06.700497 (+ 2963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:06.701191 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:06.701198 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:06.701201 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:06.701361 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:06.701876 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:06.701879 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:06.701881 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:06.702248 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:06.702484 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:06.702765 (+ 281us) server_negotiation.cc:299] Negotiation successful
0812 00:25:06.702938 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 00:25:06.704146 5475 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:06.725116 5497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.724485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:39689 (local address 127.0.0.1:42260)
0812 00:25:06.724750 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:06.724876 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:39689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260812 00:25:06.726373 5497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.725899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:39689 (local address 127.0.0.1:42264)
0812 00:25:06.726126 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:06.726225 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:39689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260812 00:25:06.799381 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 5329
I20260812 00:25:06.821821 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 4927
I20260812 00:25:06.823063 4998 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:06.941713 5497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:06.940963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:39689 (local address 127.0.0.1:42280)
0812 00:25:06.941171 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:06.941327 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:39689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 00:25:06.942052 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 4927
I20260812 00:25:26.970808 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:34895
--webserver_interface=127.18.163.254
--webserver_port=40345
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:34895
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:25:27.352942 5534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:27.353299 5534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:27.353473 5534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:27.361176 5534 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 00:25:27.361302 5534 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 00:25:27.361351 5534 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 00:25:27.361395 5534 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:25:27.361454 5534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:27.361524 5534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:27.361634 5534 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:25:27.361723 5534 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:25:27.372485 5534 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:34895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:34895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=40345
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:27.373962 5534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:27.375425 5534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:27.394246 5539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:27.394285 5542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:27.394214 5540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:27.395946 5534 server_base.cc:1034] running on GCE node
I20260812 00:25:27.396981 5534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:27.398764 5534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:27.400029 5534 hybrid_clock.cc:648] HybridClock initialized: now 1786494327399953 us; error 44 us; skew 500 ppm
I20260812 00:25:27.400491 5534 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:25:27 dist-test-slave-njxd krb5kdc[4296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494327, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:25:27.409734 5534 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:25:27.411629 5534 webserver.cc:460] Webserver started at http://127.18.163.254:40345/ using document root <none> and password file <none>
I20260812 00:25:27.412484 5534 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:27.412621 5534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:27.419036 5534 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 00:25:27.422570 5549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:27.424257 5534 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 00:25:27.424475 5534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "b1868512160a4ce1aacf868ba0fa8467"
format_stamp: "Formatted at 2026-08-12 00:24:40 on dist-test-slave-njxd"
server_key: "c9edee1444a3008f8de2affca6534955"
server_key_iv: "f79b18fda95908377b2549d4e56bf59c"
server_key_version: "encryptionkey@0"
I20260812 00:25:27.425681 5534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:27.453214 5534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:27.457985 5534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:27.458271 5534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:27.480186 5534 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:34895
I20260812 00:25:27.480225 5619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:34895 every 8 connection(s)
I20260812 00:25:27.481998 5534 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:25:27.489529 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 5534
I20260812 00:25:27.489837 5620 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:25:27.490624 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:39689
--local_ip_for_outbound_sockets=127.18.163.193
--tserver_master_addrs=127.18.163.254:34895
--webserver_port=44849
--webserver_interface=127.18.163.193
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:25:27.493746 5620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Bootstrap starting.
I20260812 00:25:27.516754 5620 log.cc:824] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Log is configured to *not* fsync() on all Append() calls
I20260812 00:25:27.536376 5620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:25:27.537132 5620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Bootstrap complete.
I20260812 00:25:27.547151 5620 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } }
I20260812 00:25:27.548135 5620 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1868512160a4ce1aacf868ba0fa8467, State: Initialized, Role: FOLLOWER
I20260812 00:25:27.548949 5620 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } }
I20260812 00:25:27.549225 5620 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:25:27.549357 5620 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:25:27.549566 5620 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 2 FOLLOWER]: Advancing to term 3
I20260812 00:25:27.554526 5620 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } }
I20260812 00:25:27.555231 5620 leader_election.cc:302] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1868512160a4ce1aacf868ba0fa8467; no voters:
I20260812 00:25:27.556057 5620 leader_election.cc:288] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 00:25:27.556227 5626 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 00:25:27.557893 5626 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [term 3 LEADER]: Becoming Leader. State: Replica: b1868512160a4ce1aacf868ba0fa8467, State: Running, Role: LEADER
I20260812 00:25:27.558537 5626 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } }
I20260812 00:25:27.558801 5620 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:25:27.562014 5629 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1868512160a4ce1aacf868ba0fa8467. Latest consensus state: current_term: 3 leader_uuid: "b1868512160a4ce1aacf868ba0fa8467" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } } }
I20260812 00:25:27.562896 5629 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [sys.catalog]: This master's current role is: LEADER
I20260812 00:25:27.562548 5627 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "b1868512160a4ce1aacf868ba0fa8467" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1868512160a4ce1aacf868ba0fa8467" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34895 } } }
I20260812 00:25:27.563485 5627 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467 [sys.catalog]: This master's current role is: LEADER
I20260812 00:25:27.573266 5635 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:25:27.583630 5635 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:25:27.585393 5635 catalog_manager.cc:1259] Loaded cluster ID: fe9ee7849fa048b9a9f684079faa2b01
I20260812 00:25:27.585626 5635 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:25:27.590317 5635 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:25:27.592504 5635 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Loaded TSK: 0
I20260812 00:25:27.592882 5635 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b1868512160a4ce1aacf868ba0fa8467: Loaded TSK: 1
F20260812 00:25:27.594426 5635 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f58124c09ad google::LogMessage::Fail() at ??:0
@ 0x7f58124c388a google::LogMessage::SendToLog() at ??:0
@ 0x7f58124c04de google::LogMessage::Flush() at ??:0
@ 0x7f58124c1a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f58162247d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f581621373e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f5827ef31c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f5827ef2783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f5827f7e2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f5827f7e0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f5827fc85e9 std::function<>::operator()() at ??:0
@ 0x7f5827ef6cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f5827ef4c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f5827f7c610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f5827f7c439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f581510c345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f581510f91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f581510f799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f58150eaeaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f58183c46db start_thread at ??:0
@ 0x7f581135a61f clone at ??:0
W20260812 00:25:27.936425 5624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:27.936833 5624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:27.937034 5624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:27.945009 5624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:27.945232 5624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:27.945436 5624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:25:27.956211 5624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:39689
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=44849
--tserver_master_addrs=127.18.163.254:34895
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:27.957828 5624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:27.959318 5624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:27.974714 5675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:27.974756 5676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:27.974802 5678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:27.979560 5624 server_base.cc:1034] running on GCE node
I20260812 00:25:27.980465 5624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:27.981711 5624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:27.983006 5624 hybrid_clock.cc:648] HybridClock initialized: now 1786494327982934 us; error 78 us; skew 500 ppm
I20260812 00:25:27.983415 5624 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:25:27 dist-test-slave-njxd krb5kdc[4296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494327, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:25:27.987146 5624 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:25:27.989002 5624 webserver.cc:460] Webserver started at http://127.18.163.193:44849/ using document root <none> and password file <none>
I20260812 00:25:27.989902 5624 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:27.990028 5624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:27.996344 5624 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.001s
I20260812 00:25:28.000191 5688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:28.002112 5624 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:25:28.002313 5624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "15d2826f2c5c4c4bb867b9cb098eac08"
format_stamp: "Formatted at 2026-08-12 00:24:41 on dist-test-slave-njxd"
server_key: "6ceef411ce40041cf038c9dfea3fa5fd"
server_key_iv: "01c449ac2be8ca0dcd31657a944ae513"
server_key_version: "encryptionkey@0"
I20260812 00:25:28.003391 5624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:28.027479 5624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:28.032204 5624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:28.032478 5624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:28.033646 5624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:25:28.035962 5696 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 00:25:28.042619 5624 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 00:25:28.042829 5624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.000s sys 0.001s
I20260812 00:25:28.042999 5624 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 00:25:28.046695 5624 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 00:25:28.046835 5624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.002s sys 0.001s
I20260812 00:25:28.047250 5696 tablet_bootstrap.cc:492] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08: Bootstrap starting.
I20260812 00:25:28.079052 5696 log.cc:824] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08: Log is configured to *not* fsync() on all Append() calls
I20260812 00:25:28.093068 5624 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:39689
I20260812 00:25:28.093092 5820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:39689 every 8 connection(s)
I20260812 00:25:28.095058 5696 tablet_bootstrap.cc:492] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:25:28.095068 5624 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:25:28.095825 5696 tablet_bootstrap.cc:492] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08: Bootstrap complete.
I20260812 00:25:28.097880 5696 ts_tablet_manager.cc:1397] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08: Time spent bootstrapping tablet: real 0.051s user 0.042s sys 0.008s
I20260812 00:25:28.100934 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 5624
I20260812 00:25:28.101470 5823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:28.098746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:39207)
0812 00:25:28.099789 (+ 1043us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:28.100212 (+ 423us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":717,"thread_start_us":497,"threads_started":1}
I20260812 00:25:28.101912 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:36151
--local_ip_for_outbound_sockets=127.18.163.194
--tserver_master_addrs=127.18.163.254:34895
--webserver_port=36847
--webserver_interface=127.18.163.194
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:25:28.102746 5821 heartbeater.cc:644] Failed to heartbeat to 127.18.163.254:34895 (0 consecutive failures): Network error: Failed to ping master at 127.18.163.254:34895: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
I20260812 00:25:28.103878 5823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:28.103441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:40441)
0812 00:25:28.103642 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:28.103737 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 00:25:28.104987 5823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:28.104555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:39311)
0812 00:25:28.104734 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:28.104836 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260812 00:25:28.105254 5821 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:25:28.110113 5696 raft_consensus.cc:348] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:25:28.111821 5696 raft_consensus.cc:729] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15d2826f2c5c4c4bb867b9cb098eac08, State: Initialized, Role: FOLLOWER
I20260812 00:25:28.112706 5696 consensus_queue.cc:260] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:25:28.114833 5823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:28.114362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:41403)
0812 00:25:28.114568 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:28.114683 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 00:25:28.115000 5696 ts_tablet_manager.cc:1428] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08: Time spent starting tablet: real 0.017s user 0.007s sys 0.008s
I20260812 00:25:28.116053 5823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:28.115664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:33563)
0812 00:25:28.115830 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:28.115912 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 00:25:28.482100 5825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:28.482419 5825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:28.482592 5825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:28.490260 5825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:28.490384 5825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:28.490578 5825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:25:28.500977 5825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:36151
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=36847
--tserver_master_addrs=127.18.163.254:34895
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:28.502465 5825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:28.503901 5825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:28.518235 5833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:28.518321 5832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:28.518342 5835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:28.519201 5825 server_base.cc:1034] running on GCE node
I20260812 00:25:28.519904 5825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:28.521016 5825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:28.522264 5825 hybrid_clock.cc:648] HybridClock initialized: now 1786494328522206 us; error 54 us; skew 500 ppm
I20260812 00:25:28.522620 5825 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:25:28 dist-test-slave-njxd krb5kdc[4296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494328, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:25:28.526239 5825 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:25:28.527910 5825 webserver.cc:460] Webserver started at http://127.18.163.194:36847/ using document root <none> and password file <none>
I20260812 00:25:28.528720 5825 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:28.528887 5825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:28.535075 5825 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260812 00:25:28.538383 5843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:28.540004 5825 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:25:28.540328 5825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "9753bf9f35e943aaa22e12fab2f7e530"
format_stamp: "Formatted at 2026-08-12 00:24:42 on dist-test-slave-njxd"
server_key: "de6fbc51bb08907850ca7a2758f453ed"
server_key_iv: "36cd54961b2092aef711b37e1edcf89b"
server_key_version: "encryptionkey@0"
I20260812 00:25:28.541477 5825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:28.571822 5825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:28.576881 5825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:28.577204 5825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:28.578444 5825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:25:28.580013 5825 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:25:28.580156 5825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:28.580299 5825 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:25:28.580390 5825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:28.618892 5825 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:36151
I20260812 00:25:28.618945 5972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:36151 every 8 connection(s)
I20260812 00:25:28.620579 5825 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:25:28.622139 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 5825
I20260812 00:25:28.623015 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:33817
--local_ip_for_outbound_sockets=127.18.163.195
--tserver_master_addrs=127.18.163.254:34895
--webserver_port=39697
--webserver_interface=127.18.163.195
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:36189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:25:28.627089 5975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:28.624517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:41601)
0812 00:25:28.625610 (+ 1093us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:28.625957 (+ 347us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":697,"thread_start_us":463,"threads_started":1}
W20260812 00:25:28.628070 5973 heartbeater.cc:644] Failed to heartbeat to 127.18.163.254:34895 (0 consecutive failures): Network error: Failed to ping master at 127.18.163.254:34895: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
I20260812 00:25:28.629223 5975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:28.628794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:35899)
0812 00:25:28.628988 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:28.629088 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 00:25:28.630594 5975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:28.630111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:41651)
0812 00:25:28.630342 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:28.630440 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
W20260812 00:25:28.630985 5973 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:25:29.002252 5977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:29.002565 5977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:29.002671 5977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:29.010620 5977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:29.010751 5977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:29.010869 5977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:25:29.021446 5977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:36189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:33817
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=39697
--tserver_master_addrs=127.18.163.254:34895
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:29.022936 5977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:29.024394 5977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:29.038903 5982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:29.038990 5983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:29.038949 5986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:29.040637 5977 server_base.cc:1034] running on GCE node
I20260812 00:25:29.041374 5977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:29.042639 5977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:29.043876 5977 hybrid_clock.cc:648] HybridClock initialized: now 1786494329043821 us; error 37 us; skew 500 ppm
I20260812 00:25:29.044258 5977 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:25:29 dist-test-slave-njxd krb5kdc[4296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494329, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:25:29.048262 5977 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:25:29.050252 5977 webserver.cc:460] Webserver started at http://127.18.163.195:39697/ using document root <none> and password file <none>
I20260812 00:25:29.051148 5977 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:29.051311 5977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:29.058005 5977 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.001s
I20260812 00:25:29.061481 5993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:29.063321 5977 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:25:29.063571 5977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167"
format_stamp: "Formatted at 2026-08-12 00:24:42 on dist-test-slave-njxd"
server_key: "8a6c7527b8cb21d960e400163e50558a"
server_key_iv: "7876f1523a2a618ebca8ceb4e4bb76a6"
server_key_version: "encryptionkey@0"
I20260812 00:25:29.064772 5977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:29.095817 5977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:29.101117 5977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:29.101457 5977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:29.102675 5977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:25:29.104224 5977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:25:29.104369 5977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:29.104517 5977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:25:29.104614 5977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:29.118381 6034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:29.117308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:50663)
0812 00:25:29.117964 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:29.118126 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":295,"threads_started":1}
I20260812 00:25:29.142381 5977 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:33817
I20260812 00:25:29.142452 6120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:33817 every 8 connection(s)
I20260812 00:25:29.143937 5977 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:25:29.149187 6124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:29.147174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:56323)
0812 00:25:29.147939 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:29.148216 (+ 277us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":283,"threads_started":1}
W20260812 00:25:29.149894 6121 heartbeater.cc:644] Failed to heartbeat to 127.18.163.254:34895 (0 consecutive failures): Network error: Failed to ping master at 127.18.163.254:34895: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
I20260812 00:25:29.150887 6124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:29.150469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:44893)
0812 00:25:29.150682 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:29.150766 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 00:25:29.151767 6124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:29.151450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:33601)
0812 00:25:29.151574 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:29.151649 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 00:25:29.152078 6121 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:25:29.152469 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 5977
I20260812 00:25:29.550287 6126 raft_consensus.cc:482] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:25:29.550632 6126 raft_consensus.cc:504] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:25:29.552593 6126 leader_election.cc:288] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9753bf9f35e943aaa22e12fab2f7e530 (127.18.163.194:36151), 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817)
Aug 12 00:25:29 dist-test-slave-njxd krb5kdc[4296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494327, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
Aug 12 00:25:29 dist-test-slave-njxd krb5kdc[4296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494327, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:25:29.576596 6128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:29.553291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:38805 (local address 127.18.163.194:36151)
0812 00:25:29.555250 (+ 1959us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:29.555275 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:29.555336 (+ 61us) server_negotiation.cc:407] Connection header received
0812 00:25:29.557039 (+ 1703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:29.557049 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:29.557469 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:29.557843 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:29.560038 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:29.561375 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:29.563270 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:29.563945 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:29.564192 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:29.568953 (+ 4761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:29.568967 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:29.568989 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:29.569046 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:29.572596 (+ 3550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:29.573378 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:29.573385 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:29.573390 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:29.573629 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:29.574124 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:29.574132 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:29.574134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:29.574693 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:29.574895 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:29.575773 (+ 878us) server_negotiation.cc:299] Negotiation successful
0812 00:25:29.576166 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1644,"thread_start_us":1506,"threads_started":1}
I20260812 00:25:29.576624 6127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:29.553266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:33817 (local address 127.18.163.193:53469)
0812 00:25:29.555563 (+ 2297us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:29.555600 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:29.555753 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:29.558338 (+ 2585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:29.558342 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:29.559045 (+ 703us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:25:29.559796 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:29.559819 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:29.561708 (+ 1889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:29.561712 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:29.563102 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:29.563116 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:29.564234 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:29.564243 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:29.564481 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:29.565371 (+ 890us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:25:29.565403 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:25:29.568672 (+ 3269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:25:29.572510 (+ 3838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:29.572520 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:29.572536 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:29.573216 (+ 680us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:29.573785 (+ 569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:29.573791 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:29.573801 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:29.573985 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:29.574851 (+ 866us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:25:29.574859 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:25:29.575223 (+ 364us) client_negotiation.cc:769] Sending connection context
0812 00:25:29.575509 (+ 286us) client_negotiation.cc:240] Negotiation successful
0812 00:25:29.576111 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2148,"mutex_wait_us":219,"spinlock_wait_cycles":55168,"thread_start_us":1946,"threads_started":1}
I20260812 00:25:29.576674 6129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:29.553535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:53469 (local address 127.18.163.195:33817)
0812 00:25:29.555939 (+ 2404us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:29.555951 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:29.555987 (+ 36us) server_negotiation.cc:407] Connection header received
0812 00:25:29.557493 (+ 1506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:29.557503 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:29.557989 (+ 486us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:29.558350 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:29.560032 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:29.561435 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:29.563263 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:29.563940 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:29.564181 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:29.569021 (+ 4840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:29.569029 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:29.569042 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:29.569087 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:29.572329 (+ 3242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:29.573401 (+ 1072us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:29.573407 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:29.573413 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:29.573650 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:29.574120 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:29.574129 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:29.574131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:29.574693 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:29.574894 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:29.575766 (+ 872us) server_negotiation.cc:299] Negotiation successful
0812 00:25:29.576207 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2200,"thread_start_us":2010,"threads_started":1}
I20260812 00:25:29.577636 6034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:29.552827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:36151 (local address 127.18.163.193:38805)
0812 00:25:29.553023 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:29.553065 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:29.553713 (+ 648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:29.558061 (+ 4348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:29.558073 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:29.559044 (+ 971us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:25:29.559796 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:29.559819 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:29.561643 (+ 1824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:29.561655 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:29.563097 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:29.563112 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:29.564178 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:29.564185 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:29.564478 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:29.565435 (+ 957us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:25:29.565459 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:25:29.568503 (+ 3044us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:25:29.572750 (+ 4247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:29.572754 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:29.572756 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:29.573209 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:29.573754 (+ 545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:29.573759 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:29.573764 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:29.573985 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:29.574851 (+ 866us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:25:29.574859 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:25:29.575223 (+ 364us) client_negotiation.cc:769] Sending connection context
0812 00:25:29.575510 (+ 287us) client_negotiation.cc:240] Negotiation successful
0812 00:25:29.577278 (+ 1768us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":1142,"spinlock_wait_cycles":21504}
W20260812 00:25:29.580446 5690 leader_election.cc:341] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817): Not found: Tablet not found: f142464ff20b43cea2c6051a864e6576
W20260812 00:25:29.580752 5690 leader_election.cc:341] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9753bf9f35e943aaa22e12fab2f7e530 (127.18.163.194:36151): Not found: Tablet not found: f142464ff20b43cea2c6051a864e6576
I20260812 00:25:29.580849 5690 leader_election.cc:302] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15d2826f2c5c4c4bb867b9cb098eac08; no voters: 322f0f3aae3d4ac6b67d8e3e7ce56167, 9753bf9f35e943aaa22e12fab2f7e530
I20260812 00:25:29.581202 6126 raft_consensus.cc:2726] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:25:29.632616 6130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:29.631646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:52273)
0812 00:25:29.632197 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:29.632351 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":264,"threads_started":1}
I20260812 00:25:30.120272 6131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:30.119537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:34339)
0812 00:25:30.119996 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:30.120088 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":230,"threads_started":1}
I20260812 00:25:30.153517 6132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:30.152703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:56019)
0812 00:25:30.153185 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:30.153307 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":233,"threads_started":1}
I20260812 00:25:30.634650 6133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:30.633852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:43131)
0812 00:25:30.634357 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:30.634452 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":260,"threads_started":1}
I20260812 00:25:31.122342 6134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:31.121390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:33173)
0812 00:25:31.122000 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:31.122109 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":312,"threads_started":1}
I20260812 00:25:31.155405 6135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:31.154571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:58225)
0812 00:25:31.155092 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:31.155205 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":264,"threads_started":1}
I20260812 00:25:31.636539 6137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:31.635691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:33921)
0812 00:25:31.636252 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:31.636351 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":280,"threads_started":1}
I20260812 00:25:31.746850 6138 raft_consensus.cc:482] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:25:31.747061 6138 raft_consensus.cc:504] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:25:31.747784 6138 leader_election.cc:288] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9753bf9f35e943aaa22e12fab2f7e530 (127.18.163.194:36151), 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817)
W20260812 00:25:31.748939 5690 leader_election.cc:341] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9753bf9f35e943aaa22e12fab2f7e530 (127.18.163.194:36151): Not found: Tablet not found: f142464ff20b43cea2c6051a864e6576
W20260812 00:25:31.749157 5690 leader_election.cc:341] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817): Not found: Tablet not found: f142464ff20b43cea2c6051a864e6576
I20260812 00:25:31.749270 5690 leader_election.cc:302] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15d2826f2c5c4c4bb867b9cb098eac08; no voters: 322f0f3aae3d4ac6b67d8e3e7ce56167, 9753bf9f35e943aaa22e12fab2f7e530
I20260812 00:25:31.749548 6138 raft_consensus.cc:2726] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:25:32.124224 6139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:32.123367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:40243)
0812 00:25:32.123884 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:32.124013 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":249,"threads_started":1}
I20260812 00:25:32.157087 6140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:32.156376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:49107)
0812 00:25:32.156838 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:32.156929 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":238,"threads_started":1}
I20260812 00:25:32.638458 6142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:32.637548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:58997)
0812 00:25:32.638169 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:32.638269 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":260,"threads_started":1}
I20260812 00:25:33.126374 6143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:33.125532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:50645)
0812 00:25:33.126081 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:33.126171 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":266,"threads_started":1}
I20260812 00:25:33.159098 6144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:33.158176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:44397)
0812 00:25:33.158817 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:33.158909 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":318,"threads_started":1}
I20260812 00:25:33.640380 6145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:33.639571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:59827)
0812 00:25:33.640098 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:33.640200 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":262,"threads_started":1}
I20260812 00:25:33.877748 6146 raft_consensus.cc:482] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:25:33.877950 6146 raft_consensus.cc:504] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:25:33.878640 6146 leader_election.cc:288] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9753bf9f35e943aaa22e12fab2f7e530 (127.18.163.194:36151), 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817)
W20260812 00:25:33.879779 5690 leader_election.cc:341] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9753bf9f35e943aaa22e12fab2f7e530 (127.18.163.194:36151): Not found: Tablet not found: f142464ff20b43cea2c6051a864e6576
W20260812 00:25:33.880076 5690 leader_election.cc:341] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817): Not found: Tablet not found: f142464ff20b43cea2c6051a864e6576
I20260812 00:25:33.880215 5690 leader_election.cc:302] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15d2826f2c5c4c4bb867b9cb098eac08; no voters: 322f0f3aae3d4ac6b67d8e3e7ce56167, 9753bf9f35e943aaa22e12fab2f7e530
I20260812 00:25:33.880545 6146 raft_consensus.cc:2726] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:25:34.128433 6147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:34.127418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:58785)
0812 00:25:34.128120 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:34.128217 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":413,"threads_started":1}
I20260812 00:25:34.161302 6148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:34.160220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:45011)
0812 00:25:34.160965 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:34.161073 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":429,"threads_started":1}
I20260812 00:25:34.642297 6150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:34.641443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:34367)
0812 00:25:34.642006 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:34.642109 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":328,"threads_started":1}
I20260812 00:25:35.130299 6151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:35.129451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:48499)
0812 00:25:35.129988 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:35.130086 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":322,"threads_started":1}
I20260812 00:25:35.163151 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:35.162296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:35169)
0812 00:25:35.162859 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:35.162943 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":327,"threads_started":1}
I20260812 00:25:35.644343 6153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:35.643407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:50753)
0812 00:25:35.644030 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:35.644130 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":306,"threads_started":1}
I20260812 00:25:35.723448 6154 raft_consensus.cc:482] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:25:35.723707 6154 raft_consensus.cc:504] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:25:35.724486 6154 leader_election.cc:288] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9753bf9f35e943aaa22e12fab2f7e530 (127.18.163.194:36151), 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817)
W20260812 00:25:35.725648 5690 leader_election.cc:341] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9753bf9f35e943aaa22e12fab2f7e530 (127.18.163.194:36151): Not found: Tablet not found: f142464ff20b43cea2c6051a864e6576
W20260812 00:25:35.725893 5690 leader_election.cc:341] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817): Not found: Tablet not found: f142464ff20b43cea2c6051a864e6576
I20260812 00:25:35.725971 5690 leader_election.cc:302] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15d2826f2c5c4c4bb867b9cb098eac08; no voters: 322f0f3aae3d4ac6b67d8e3e7ce56167, 9753bf9f35e943aaa22e12fab2f7e530
I20260812 00:25:35.726233 6154 raft_consensus.cc:2726] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:25:36.132057 6155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:36.131240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:52673)
0812 00:25:36.131731 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:36.131860 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":252,"threads_started":1}
I20260812 00:25:36.165015 6156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:36.164149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:47593)
0812 00:25:36.164723 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:36.164808 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":254,"threads_started":1}
I20260812 00:25:36.646319 6158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:36.645375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:40647)
0812 00:25:36.646018 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:36.646120 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":387,"threads_started":1}
I20260812 00:25:37.134086 6159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:37.133262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:39853)
0812 00:25:37.133779 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:37.133867 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":249,"threads_started":1}
I20260812 00:25:37.167217 6160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:37.166214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:59907)
0812 00:25:37.166795 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:37.166916 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":309,"threads_started":1}
I20260812 00:25:37.648319 6161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:37.647362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:35973)
0812 00:25:37.648009 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:37.648112 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":334,"threads_started":1}
I20260812 00:25:38.136152 6162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:38.135341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:55209)
0812 00:25:38.135860 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:38.135959 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":272,"threads_started":1}
I20260812 00:25:38.169313 6163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:38.168439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:40567)
0812 00:25:38.169032 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:38.169136 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":332,"threads_started":1}
I20260812 00:25:38.552340 6164 raft_consensus.cc:482] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:25:38.552542 6164 raft_consensus.cc:504] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d2826f2c5c4c4bb867b9cb098eac08" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39689 } } peers { permanent_uuid: "9753bf9f35e943aaa22e12fab2f7e530" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36151 } } peers { permanent_uuid: "322f0f3aae3d4ac6b67d8e3e7ce56167" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33817 } }
I20260812 00:25:38.553205 6164 leader_election.cc:288] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9753bf9f35e943aaa22e12fab2f7e530 (127.18.163.194:36151), 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817)
W20260812 00:25:38.554345 5690 leader_election.cc:341] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9753bf9f35e943aaa22e12fab2f7e530 (127.18.163.194:36151): Not found: Tablet not found: f142464ff20b43cea2c6051a864e6576
W20260812 00:25:38.554559 5690 leader_election.cc:341] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 322f0f3aae3d4ac6b67d8e3e7ce56167 (127.18.163.195:33817): Not found: Tablet not found: f142464ff20b43cea2c6051a864e6576
I20260812 00:25:38.554659 5690 leader_election.cc:302] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15d2826f2c5c4c4bb867b9cb098eac08; no voters: 322f0f3aae3d4ac6b67d8e3e7ce56167, 9753bf9f35e943aaa22e12fab2f7e530
I20260812 00:25:38.554913 6164 raft_consensus.cc:2726] T f142464ff20b43cea2c6051a864e6576 P 15d2826f2c5c4c4bb867b9cb098eac08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:25:38.650501 6166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:38.649687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:36127)
0812 00:25:38.650200 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:38.650310 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":254,"threads_started":1}
I20260812 00:25:39.138072 6168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:39.137239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:42571)
0812 00:25:39.137797 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:39.137888 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":244,"threads_started":1}
I20260812 00:25:39.171265 6169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:39.170503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:35273)
0812 00:25:39.170988 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:39.171079 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":252,"threads_started":1}
I20260812 00:25:39.652474 6170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:39.651645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:38945)
0812 00:25:39.652186 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:39.652296 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":248,"threads_started":1}
I20260812 00:25:40.139860 6171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:40.139068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:50699)
0812 00:25:40.139590 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:40.139675 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":292,"threads_started":1}
I20260812 00:25:40.173020 6172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:40.172261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:51599)
0812 00:25:40.172769 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:40.172852 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":248,"threads_started":1}
I20260812 00:25:40.654573 6173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:40.653746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:49343)
0812 00:25:40.654253 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:40.654357 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":249,"threads_started":1}
I20260812 00:25:41.142048 6174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:41.141015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:32809)
0812 00:25:41.141748 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:41.141857 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":381,"threads_started":1}
I20260812 00:25:41.175004 6176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:41.174147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:57357)
0812 00:25:41.174726 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:41.174815 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":318,"threads_started":1}
I20260812 00:25:41.656546 6177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:41.655747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:56963)
0812 00:25:41.656250 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:41.656358 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":247,"threads_started":1}
I20260812 00:25:42.144243 6179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:42.143172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:50115)
0812 00:25:42.143848 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:42.143975 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":324,"threads_started":1}
I20260812 00:25:42.176959 6180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:42.176079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:56523)
0812 00:25:42.176629 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:42.176778 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":271,"threads_started":1}
I20260812 00:25:42.658510 6181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:42.657645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:46907)
0812 00:25:42.658180 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:42.658288 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":258,"threads_started":1}
I20260812 00:25:43.146746 6182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:43.145853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:50679)
0812 00:25:43.146458 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:43.146576 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":286,"threads_started":1}
I20260812 00:25:43.178939 6183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:43.178045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:33755)
0812 00:25:43.178554 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:43.178646 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":282,"threads_started":1}
I20260812 00:25:43.660823 6184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:43.659865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.194:45191)
0812 00:25:43.660419 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:43.660532 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":272,"threads_started":1}
I20260812 00:25:44.148924 6185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:44.147799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.193:57581)
0812 00:25:44.148412 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:44.148570 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":272,"threads_started":1}
I20260812 00:25:44.160105 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 5624
I20260812 00:25:44.177335 6186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:44.161414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40328 (local address 127.18.163.193:39689)
0812 00:25:44.162161 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:44.162169 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:44.162201 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:25:44.162473 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:44.162493 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:44.162848 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:44.163058 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:44.164640 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:44.165836 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:44.167202 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:44.167816 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:44.167937 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:44.171166 (+ 3229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:44.171182 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:44.171199 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:44.171241 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:44.174319 (+ 3078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:44.175179 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:44.175188 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:44.175190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:44.175335 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:44.175722 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:44.175726 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:44.175728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:44.176113 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:44.176373 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:44.176669 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 00:25:44.176910 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":385,"threads_started":1}
I20260812 00:25:44.178817 5815 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:44.181331 6188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:44.180301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34895 (local address 127.18.163.195:53595)
0812 00:25:44.180926 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:44.181093 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.254:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":307,"threads_started":1}
I20260812 00:25:44.274920 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 5624
I20260812 00:25:44.301112 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 5825
I20260812 00:25:44.316730 6189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:44.302144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59108 (local address 127.18.163.194:36151)
0812 00:25:44.302709 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:44.302714 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:44.302733 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:25:44.302793 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:44.302797 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:44.302862 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:44.302963 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:44.304540 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:44.305399 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:44.306997 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:44.307487 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:44.307600 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:44.310760 (+ 3160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:44.310765 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:44.310769 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:44.310808 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:44.313914 (+ 3106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:44.314818 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:44.314822 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:44.314825 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:44.314979 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:44.315355 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:44.315358 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:44.315360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:44.315671 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:44.315895 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:44.316198 (+ 303us) server_negotiation.cc:299] Negotiation successful
0812 00:25:44.316410 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":294,"threads_started":1}
I20260812 00:25:44.317564 5967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:44.406579 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 5825
I20260812 00:25:44.429474 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 5977
I20260812 00:25:44.446013 6191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:44.430533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42532 (local address 127.18.163.195:33817)
0812 00:25:44.431190 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:44.431195 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:44.431212 (+ 17us) server_negotiation.cc:407] Connection header received
0812 00:25:44.431273 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:44.431277 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:44.431350 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:44.431489 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:44.433043 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:44.434074 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:44.435453 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:44.435955 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:44.436121 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:44.439616 (+ 3495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:44.439623 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:44.439627 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:44.439681 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:44.442762 (+ 3081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:44.443650 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:44.443656 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:44.443660 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:44.443830 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:44.444302 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:44.444308 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:44.444312 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:44.444634 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:44.444962 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:44.445280 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 00:25:44.445543 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":360,"threads_started":1}
I20260812 00:25:44.446864 6115 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:44.535300 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 5977
2026-08-12T00:25:44Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65820 ms)
[----------] 30 tests from SecurityITest (319936 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:25:44 dist-test-slave-njxd krb5kdc[6195](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:25:44 dist-test-slave-njxd krb5kdc[6195](info): set up 2 sockets
Aug 12 00:25:44 dist-test-slave-njxd krb5kdc[6195](info): commencing operation
krb5kdc: starting...
W20260812 00:25:45.770691 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.187s user 0.004s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:25:46 dist-test-slave-njxd krb5kdc[6195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:25:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:25:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:25:46.158748 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:34513
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:33447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:34513
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:25:46.539535 6210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:46.539906 6210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:46.540086 6210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:46.547814 6210 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:25:46.547967 6210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:46.548087 6210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:46.548213 6210 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:25:46.548297 6210 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:25:46.559065 6210 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:33447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:34513
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:34513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:46.560663 6210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:46.562269 6210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:46.576601 6215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:46.576624 6216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:46.576668 6218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:46.577625 6210 server_base.cc:1034] running on GCE node
I20260812 00:25:46.578696 6210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:46.580435 6210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:46.581779 6210 hybrid_clock.cc:648] HybridClock initialized: now 1786494346581695 us; error 41 us; skew 500 ppm
I20260812 00:25:46.582204 6210 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:25:46 dist-test-slave-njxd krb5kdc[6195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494346, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:25:46.591008 6210 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:25:46.592954 6210 webserver.cc:460] Webserver started at http://127.18.163.254:34531/ using document root <none> and password file <none>
I20260812 00:25:46.593901 6210 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:46.594043 6210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:46.594370 6210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:25:46.598120 6210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "9efd57bc0a2d4fdaa4f7cef37884a86a"
format_stamp: "Formatted at 2026-08-12 00:25:46 on dist-test-slave-njxd"
server_key: "ca79ff81b6cbdaff94c234963d2b2b81"
server_key_iv: "b4bc4ead61d1b25b2a6bcd7499788df6"
server_key_version: "encryptionkey@0"
I20260812 00:25:46.599001 6210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "9efd57bc0a2d4fdaa4f7cef37884a86a"
format_stamp: "Formatted at 2026-08-12 00:25:46 on dist-test-slave-njxd"
server_key: "ca79ff81b6cbdaff94c234963d2b2b81"
server_key_iv: "b4bc4ead61d1b25b2a6bcd7499788df6"
server_key_version: "encryptionkey@0"
I20260812 00:25:46.605329 6210 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.002s
I20260812 00:25:46.609963 6225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:46.611726 6210 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:25:46.611968 6210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "9efd57bc0a2d4fdaa4f7cef37884a86a"
format_stamp: "Formatted at 2026-08-12 00:25:46 on dist-test-slave-njxd"
server_key: "ca79ff81b6cbdaff94c234963d2b2b81"
server_key_iv: "b4bc4ead61d1b25b2a6bcd7499788df6"
server_key_version: "encryptionkey@0"
I20260812 00:25:46.612223 6210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:46.635087 6210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:46.640815 6210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:46.641206 6210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:46.663841 6210 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:34513
I20260812 00:25:46.663863 6291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:34513 every 8 connection(s)
I20260812 00:25:46.665513 6210 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:25:46.668462 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 6210
I20260812 00:25:46.668735 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:25:46.669648 19087 external_mini_cluster.cc:1428] Setting key e053d5ab9ce1f0d5bee81ebc170101ab
I20260812 00:25:46.671450 6292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:25:46.687865 6292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a: Bootstrap starting.
I20260812 00:25:46.691969 6292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a: Neither blocks nor log segments found. Creating new log.
I20260812 00:25:46.693186 6292 log.cc:824] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a: Log is configured to *not* fsync() on all Append() calls
Aug 12 00:25:46 dist-test-slave-njxd krb5kdc[6195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:25:46.698139 6292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a: No bootstrap required, opened a new log
I20260812 00:25:46.704689 6295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:46.678614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55696 (local address 127.18.163.254:34513)
0812 00:25:46.679618 (+ 1004us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:46.679638 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:46.679699 (+ 61us) server_negotiation.cc:407] Connection header received
0812 00:25:46.682265 (+ 2566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:46.682300 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:46.682907 (+ 607us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:46.683443 (+ 536us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:46.685026 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:46.687233 (+ 2207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:46.688800 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:46.690003 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:46.690247 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:46.695012 (+ 4765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:46.695024 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:46.695045 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:46.695090 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:46.699027 (+ 3937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:46.700149 (+ 1122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:46.700155 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:46.700166 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:46.700376 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:46.700877 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:46.700880 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:46.700882 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:46.701528 (+ 646us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:46.701902 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:46.702425 (+ 523us) server_negotiation.cc:299] Negotiation successful
0812 00:25:46.702969 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":489,"threads_started":1}
I20260812 00:25:46.708418 6292 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efd57bc0a2d4fdaa4f7cef37884a86a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34513 } }
I20260812 00:25:46.708868 6292 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:25:46.708999 6292 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9efd57bc0a2d4fdaa4f7cef37884a86a, State: Initialized, Role: FOLLOWER
I20260812 00:25:46.709748 6292 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efd57bc0a2d4fdaa4f7cef37884a86a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34513 } }
I20260812 00:25:46.710021 6292 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:25:46.710168 6292 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:25:46.710348 6292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:25:46.713157 6292 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efd57bc0a2d4fdaa4f7cef37884a86a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34513 } }
I20260812 00:25:46.713824 6292 leader_election.cc:302] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9efd57bc0a2d4fdaa4f7cef37884a86a; no voters:
I20260812 00:25:46.714563 6292 leader_election.cc:288] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:25:46.714740 6299 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:25:46.716418 6299 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [term 1 LEADER]: Becoming Leader. State: Replica: 9efd57bc0a2d4fdaa4f7cef37884a86a, State: Running, Role: LEADER
I20260812 00:25:46.716951 6292 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:25:46.717203 6299 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efd57bc0a2d4fdaa4f7cef37884a86a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34513 } }
I20260812 00:25:46.720716 6301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9efd57bc0a2d4fdaa4f7cef37884a86a. Latest consensus state: current_term: 1 leader_uuid: "9efd57bc0a2d4fdaa4f7cef37884a86a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efd57bc0a2d4fdaa4f7cef37884a86a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34513 } } }
I20260812 00:25:46.720798 6300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9efd57bc0a2d4fdaa4f7cef37884a86a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efd57bc0a2d4fdaa4f7cef37884a86a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 34513 } } }
I20260812 00:25:46.721138 6301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [sys.catalog]: This master's current role is: LEADER
I20260812 00:25:46.721197 6300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a [sys.catalog]: This master's current role is: LEADER
I20260812 00:25:46.731281 6310 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:25:46.737421 6310 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:25:46.747949 6310 catalog_manager.cc:1347] Generated new cluster ID: c16dec5220ed47219b20f761305e7721
I20260812 00:25:46.748108 6310 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:25:46.774881 6310 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:25:46.776401 6310 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:25:46.787374 6310 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a: Generated new TSK 0
I20260812 00:25:46.788398 6310 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:25:46.888096 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34513
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:33447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:25:47.279425 6321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:47.279788 6321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:47.279964 6321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:47.288096 6321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:47.288280 6321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:47.288462 6321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:25:47.299388 6321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:33447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34513
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:47.300877 6321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:47.302489 6321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:47.317106 6326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:47.317091 6327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:47.317160 6329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:47.318486 6321 server_base.cc:1034] running on GCE node
I20260812 00:25:47.319165 6321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:47.320318 6321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:47.321556 6321 hybrid_clock.cc:648] HybridClock initialized: now 1786494347321508 us; error 47 us; skew 500 ppm
I20260812 00:25:47.321962 6321 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:25:47 dist-test-slave-njxd krb5kdc[6195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494347, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:25:47.325366 6321 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:25:47.327200 6321 webserver.cc:460] Webserver started at http://127.18.163.193:36691/ using document root <none> and password file <none>
I20260812 00:25:47.328015 6321 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:47.328183 6321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:47.328540 6321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:25:47.331840 6321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "a8e8238daa104176be83bdbdf70fa4c6"
format_stamp: "Formatted at 2026-08-12 00:25:47 on dist-test-slave-njxd"
server_key: "60a0ea8296ced4bf497133672989cf0e"
server_key_iv: "a4e84845219047b5f5fc710fbe34f3a4"
server_key_version: "encryptionkey@0"
I20260812 00:25:47.332717 6321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "a8e8238daa104176be83bdbdf70fa4c6"
format_stamp: "Formatted at 2026-08-12 00:25:47 on dist-test-slave-njxd"
server_key: "60a0ea8296ced4bf497133672989cf0e"
server_key_iv: "a4e84845219047b5f5fc710fbe34f3a4"
server_key_version: "encryptionkey@0"
I20260812 00:25:47.338614 6321 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 00:25:47.342753 6337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:47.344292 6321 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:25:47.344511 6321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "a8e8238daa104176be83bdbdf70fa4c6"
format_stamp: "Formatted at 2026-08-12 00:25:47 on dist-test-slave-njxd"
server_key: "60a0ea8296ced4bf497133672989cf0e"
server_key_iv: "a4e84845219047b5f5fc710fbe34f3a4"
server_key_version: "encryptionkey@0"
I20260812 00:25:47.344772 6321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:47.373833 6321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:47.378633 6321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:47.378973 6321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:47.380064 6321 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:25:47.381732 6321 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:25:47.381839 6321 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:47.381994 6321 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:25:47.382071 6321 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:47.419018 6321 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:39077
I20260812 00:25:47.419065 6464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:39077 every 8 connection(s)
I20260812 00:25:47.420468 6321 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:25:47.421952 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 6321
I20260812 00:25:47.422194 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:25:47.423095 19087 external_mini_cluster.cc:1428] Setting key 4a8ac0a8bce4fe95635b194d03a3e524
Aug 12 00:25:47 dist-test-slave-njxd krb5kdc[6195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494347, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:25:47.449321 6467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:47.423868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:45355 (local address 127.18.163.254:34513)
0812 00:25:47.424414 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:47.424419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:47.425806 (+ 1387us) server_negotiation.cc:407] Connection header received
0812 00:25:47.428993 (+ 3187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:47.428999 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:47.429079 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:47.429187 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:47.431658 (+ 2471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:47.432401 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:47.435217 (+ 2816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:47.435662 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:47.435774 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:47.441022 (+ 5248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:47.441029 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:47.441032 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:47.441083 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:47.445146 (+ 4063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:47.446371 (+ 1225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:47.446376 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:47.446379 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:47.446535 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:47.447097 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:47.447101 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:47.447103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:47.447416 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:47.447603 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:47.448562 (+ 959us) server_negotiation.cc:299] Negotiation successful
0812 00:25:47.448884 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":301,"threads_started":1}
I20260812 00:25:47.450621 6468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:47.424557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34513 (local address 127.18.163.193:45355)
0812 00:25:47.425604 (+ 1047us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:47.425677 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:47.428618 (+ 2941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:47.429507 (+ 889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:47.429522 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:47.430469 (+ 947us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:25:47.431404 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:47.431436 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:47.432620 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:47.432628 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:47.434996 (+ 2368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:47.435027 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:47.435946 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:47.435956 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:47.436315 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:47.437190 (+ 875us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:25:47.437228 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:25:47.440628 (+ 3400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:25:47.445412 (+ 4784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:47.445430 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:47.445460 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:47.446162 (+ 702us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:47.446702 (+ 540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:47.446706 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:47.446708 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:47.446945 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:47.447578 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:25:47.447588 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:25:47.448019 (+ 431us) client_negotiation.cc:769] Sending connection context
0812 00:25:47.448427 (+ 408us) client_negotiation.cc:240] Negotiation successful
0812 00:25:47.449096 (+ 669us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"thread_start_us":424,"threads_started":1}
I20260812 00:25:47.452692 6465 heartbeater.cc:347] Connected to a master server at 127.18.163.254:34513
I20260812 00:25:47.453064 6465 heartbeater.cc:464] Registering TS with master...
I20260812 00:25:47.453976 6465 heartbeater.cc:511] Master 127.18.163.254:34513 requested a full tablet report, sending...
I20260812 00:25:47.456866 6245 ts_manager.cc:194] Registered new tserver with Master: a8e8238daa104176be83bdbdf70fa4c6 (127.18.163.193:39077)
I20260812 00:25:47.459592 6245 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:45355
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:25:47.509554 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34513
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:33447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:25:47.891391 6472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:47.891733 6472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:47.891913 6472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:47.899843 6472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:47.899981 6472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:47.900199 6472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:25:47.910903 6472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:33447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34513
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:47.912397 6472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:47.914019 6472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:47.928730 6479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:47.928717 6478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:47.928972 6481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:47.929816 6472 server_base.cc:1034] running on GCE node
I20260812 00:25:47.930501 6472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:47.931555 6472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:47.932783 6472 hybrid_clock.cc:648] HybridClock initialized: now 1786494347932727 us; error 56 us; skew 500 ppm
I20260812 00:25:47.933167 6472 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:25:47 dist-test-slave-njxd krb5kdc[6195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494347, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:25:47.936839 6472 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:25:47.938597 6472 webserver.cc:460] Webserver started at http://127.18.163.194:37863/ using document root <none> and password file <none>
I20260812 00:25:47.939409 6472 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:47.939566 6472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:47.939925 6472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:25:47.943246 6472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "98e4317bb6174b428493a91f23b7d541"
format_stamp: "Formatted at 2026-08-12 00:25:47 on dist-test-slave-njxd"
server_key: "aeb8e227f58e5afca85e3515a88ee539"
server_key_iv: "ff30811ec1d0ce48c63933b9e1d4d17d"
server_key_version: "encryptionkey@0"
I20260812 00:25:47.944119 6472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "98e4317bb6174b428493a91f23b7d541"
format_stamp: "Formatted at 2026-08-12 00:25:47 on dist-test-slave-njxd"
server_key: "aeb8e227f58e5afca85e3515a88ee539"
server_key_iv: "ff30811ec1d0ce48c63933b9e1d4d17d"
server_key_version: "encryptionkey@0"
I20260812 00:25:47.950551 6472 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 00:25:47.955049 6488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:47.956725 6472 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.004s
I20260812 00:25:47.956966 6472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "98e4317bb6174b428493a91f23b7d541"
format_stamp: "Formatted at 2026-08-12 00:25:47 on dist-test-slave-njxd"
server_key: "aeb8e227f58e5afca85e3515a88ee539"
server_key_iv: "ff30811ec1d0ce48c63933b9e1d4d17d"
server_key_version: "encryptionkey@0"
I20260812 00:25:47.957201 6472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:47.975206 6472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:47.980090 6472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:47.980448 6472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:47.981564 6472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:25:47.983289 6472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:25:47.983376 6472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:47.983538 6472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:25:47.983613 6472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:48.020617 6472 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:33301
I20260812 00:25:48.020658 6614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:33301 every 8 connection(s)
I20260812 00:25:48.022243 6472 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:25:48.030213 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 6472
I20260812 00:25:48.030418 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:25:48.030915 19087 external_mini_cluster.cc:1428] Setting key 8492c80ddfa470d682741f3f82a4cf13
Aug 12 00:25:48 dist-test-slave-njxd krb5kdc[6195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494347, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:25:48.046939 6617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:48.025086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:36335 (local address 127.18.163.254:34513)
0812 00:25:48.025663 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:48.025675 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:48.026792 (+ 1117us) server_negotiation.cc:407] Connection header received
0812 00:25:48.028812 (+ 2020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:48.028819 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:48.028925 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:48.029057 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:48.030981 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.031866 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.034119 (+ 2253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.034962 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.035119 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:48.039161 (+ 4042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:48.039170 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:48.039178 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:48.039231 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:48.043153 (+ 3922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:48.044055 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:48.044063 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:48.044068 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:48.044244 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:48.044688 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:48.044696 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:48.044702 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:48.045123 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:48.045294 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:48.046114 (+ 820us) server_negotiation.cc:299] Negotiation successful
0812 00:25:48.046404 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":258,"threads_started":1}
I20260812 00:25:48.047669 6618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:48.025783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34513 (local address 127.18.163.194:36335)
0812 00:25:48.026590 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:48.026646 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:48.028489 (+ 1843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:48.029337 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:48.029346 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:48.030033 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:25:48.030770 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:48.030792 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.032087 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.032095 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:48.033939 (+ 1844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:48.033955 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.035204 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.035208 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:48.035427 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:48.036167 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:25:48.036192 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:25:48.038854 (+ 2662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:25:48.043368 (+ 4514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:48.043376 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:48.043393 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:48.043902 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:48.044359 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:48.044362 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:48.044365 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:48.044562 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:48.045258 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:25:48.045264 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:25:48.045708 (+ 444us) client_negotiation.cc:769] Sending connection context
0812 00:25:48.045962 (+ 254us) client_negotiation.cc:240] Negotiation successful
0812 00:25:48.046407 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":332,"threads_started":1}
I20260812 00:25:48.049546 6615 heartbeater.cc:347] Connected to a master server at 127.18.163.254:34513
I20260812 00:25:48.049965 6615 heartbeater.cc:464] Registering TS with master...
I20260812 00:25:48.051016 6615 heartbeater.cc:511] Master 127.18.163.254:34513 requested a full tablet report, sending...
I20260812 00:25:48.052863 6245 ts_manager.cc:194] Registered new tserver with Master: 98e4317bb6174b428493a91f23b7d541 (127.18.163.194:33301)
I20260812 00:25:48.053819 6245 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:36335
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
I20260812 00:25:48.112952 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34513
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:33447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:25:48.463891 6465 heartbeater.cc:503] Master 127.18.163.254:34513 was elected leader, sending a full tablet report...
W20260812 00:25:48.494184 6622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:48.494514 6622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:48.494644 6622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:48.502377 6622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:48.502511 6622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:48.502640 6622 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:25:48.512969 6622 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:33447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:34513
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:48.514564 6622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:48.516188 6622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:48.531131 6627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:48.531064 6628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:48.531211 6630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:48.532051 6622 server_base.cc:1034] running on GCE node
I20260812 00:25:48.532795 6622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:48.533977 6622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:48.535262 6622 hybrid_clock.cc:648] HybridClock initialized: now 1786494348535205 us; error 49 us; skew 500 ppm
I20260812 00:25:48.535669 6622 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:25:48 dist-test-slave-njxd krb5kdc[6195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494348, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:25:48.539198 6622 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:25:48.540899 6622 webserver.cc:460] Webserver started at http://127.18.163.195:43475/ using document root <none> and password file <none>
I20260812 00:25:48.541718 6622 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:48.541873 6622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:48.542208 6622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:25:48.545293 6622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "9663d4e87adc4bd2b7ce18fbfcb9d9a3"
format_stamp: "Formatted at 2026-08-12 00:25:48 on dist-test-slave-njxd"
server_key: "7554acf8ce03644eb00e472765e504fd"
server_key_iv: "26b0d69a7984f9665532f72da40dc640"
server_key_version: "encryptionkey@0"
I20260812 00:25:48.546216 6622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "9663d4e87adc4bd2b7ce18fbfcb9d9a3"
format_stamp: "Formatted at 2026-08-12 00:25:48 on dist-test-slave-njxd"
server_key: "7554acf8ce03644eb00e472765e504fd"
server_key_iv: "26b0d69a7984f9665532f72da40dc640"
server_key_version: "encryptionkey@0"
I20260812 00:25:48.552330 6622 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:25:48.556284 6638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:48.557904 6622 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 00:25:48.558115 6622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "9663d4e87adc4bd2b7ce18fbfcb9d9a3"
format_stamp: "Formatted at 2026-08-12 00:25:48 on dist-test-slave-njxd"
server_key: "7554acf8ce03644eb00e472765e504fd"
server_key_iv: "26b0d69a7984f9665532f72da40dc640"
server_key_version: "encryptionkey@0"
I20260812 00:25:48.558349 6622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:48.570775 6622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:48.575636 6622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:48.575965 6622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:48.577006 6622 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:25:48.578521 6622 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:25:48.578639 6622 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:48.578794 6622 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:25:48.578871 6622 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:48.615046 6622 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:44427
I20260812 00:25:48.615087 6765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:44427 every 8 connection(s)
I20260812 00:25:48.616680 6622 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:25:48.622020 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 6622
I20260812 00:25:48.622239 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:25:48.622733 19087 external_mini_cluster.cc:1428] Setting key 5f7e86d2e4294e649a246d0d4fcf2ed7
Aug 12 00:25:48 dist-test-slave-njxd krb5kdc[6195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494348, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:25:48.640162 6769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:48.619667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:48213 (local address 127.18.163.254:34513)
0812 00:25:48.620215 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:48.620222 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:48.621424 (+ 1202us) server_negotiation.cc:407] Connection header received
0812 00:25:48.623622 (+ 2198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:48.623628 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:48.623725 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:48.623863 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:48.625948 (+ 2085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.626822 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.628557 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.628972 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.629073 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:48.633404 (+ 4331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:48.633410 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:48.633413 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:48.633451 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:48.636468 (+ 3017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:48.637673 (+ 1205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:48.637678 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:48.637680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:48.637824 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:48.638340 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:48.638350 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:48.638352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:48.638719 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:48.638865 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:48.639675 (+ 810us) server_negotiation.cc:299] Negotiation successful
0812 00:25:48.639867 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":240,"threads_started":1}
I20260812 00:25:48.641259 6770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:48.620322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:34513 (local address 127.18.163.195:48213)
0812 00:25:48.621217 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:48.621262 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:48.623279 (+ 2017us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:48.624218 (+ 939us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:48.624241 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:48.624960 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:25:48.625696 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:48.625734 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.627016 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.627020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:48.628391 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:48.628406 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.629202 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.629207 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:48.629424 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:48.630249 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:25:48.630274 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:25:48.633114 (+ 2840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:25:48.636708 (+ 3594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:48.636719 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:48.636740 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:48.637465 (+ 725us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:48.637957 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:48.637963 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:48.637967 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:48.638207 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:48.638879 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:25:48.638888 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:25:48.639297 (+ 409us) client_negotiation.cc:769] Sending connection context
0812 00:25:48.639558 (+ 261us) client_negotiation.cc:240] Negotiation successful
0812 00:25:48.640005 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":373,"threads_started":1}
I20260812 00:25:48.642885 6766 heartbeater.cc:347] Connected to a master server at 127.18.163.254:34513
I20260812 00:25:48.643211 6766 heartbeater.cc:464] Registering TS with master...
I20260812 00:25:48.643949 6766 heartbeater.cc:511] Master 127.18.163.254:34513 requested a full tablet report, sending...
I20260812 00:25:48.645493 6245 ts_manager.cc:194] Registered new tserver with Master: 9663d4e87adc4bd2b7ce18fbfcb9d9a3 (127.18.163.195:44427)
I20260812 00:25:48.646442 6245 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:48213
I20260812 00:25:48.651598 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:25:48.671743 6769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:48.656750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55698 (local address 127.18.163.254:34513)
0812 00:25:48.657046 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:48.657056 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:48.657658 (+ 602us) server_negotiation.cc:407] Connection header received
0812 00:25:48.657897 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:48.657902 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:48.657977 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:48.658086 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:48.659641 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.660434 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.662102 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.662618 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.662724 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:48.665475 (+ 2751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:48.665481 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:48.665484 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:48.665526 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:48.668543 (+ 3017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:48.669418 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:48.669425 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:48.669429 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:48.669644 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:48.670070 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:48.670078 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:48.670082 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:48.670481 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:48.670764 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:48.671156 (+ 392us) server_negotiation.cc:299] Negotiation successful
0812 00:25:48.671413 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 00:25:48.676226 6245 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55698:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:25:48.683795 6245 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:25:48.708745 6786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:48.698504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56816 (local address 127.18.163.195:44427)
0812 00:25:48.699369 (+ 865us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:48.699381 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:48.700521 (+ 1140us) server_negotiation.cc:407] Connection header received
0812 00:25:48.700636 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:48.700646 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:48.700883 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:48.701091 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:48.702206 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.703786 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.706425 (+ 2639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.707480 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.707705 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:48.707879 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:48.708217 (+ 338us) server_negotiation.cc:299] Negotiation successful
0812 00:25:48.708393 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":439,"threads_started":1}
I20260812 00:25:48.708815 6784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:48.697866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:44427 (local address 127.0.0.1:56816)
0812 00:25:48.700199 (+ 2333us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:48.700240 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:48.700379 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:48.701403 (+ 1024us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:48.701408 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:48.701471 (+ 63us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:48.701950 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:48.701965 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.703946 (+ 1981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.703951 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:48.706213 (+ 2262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:48.706227 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.707707 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.707713 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:48.707955 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:48.708006 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 00:25:48.708156 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 00:25:48.708356 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2229,"mutex_wait_us":1,"spinlock_wait_cycles":22272,"thread_start_us":2394,"threads_started":1}
I20260812 00:25:48.708837 6780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:48.697837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38952 (local address 127.18.163.193:39077)
0812 00:25:48.698642 (+ 805us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:48.698657 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:48.699721 (+ 1064us) server_negotiation.cc:407] Connection header received
0812 00:25:48.700076 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:48.700085 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:48.700358 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:48.700639 (+ 281us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:48.701380 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.703069 (+ 1689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.705619 (+ 2550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.707243 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.707426 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:48.707652 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:48.708295 (+ 643us) server_negotiation.cc:299] Negotiation successful
0812 00:25:48.708478 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":906,"threads_started":1}
I20260812 00:25:48.709717 6783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:48.697802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:39077 (local address 127.0.0.1:38952)
0812 00:25:48.699510 (+ 1708us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:48.699593 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:48.699792 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:48.700618 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:48.700627 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:48.700659 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:48.701154 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:48.701172 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.703238 (+ 2066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.703244 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:48.705108 (+ 1864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:48.705122 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.707859 (+ 2737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.707865 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:48.708052 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:48.708096 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 00:25:48.709136 (+ 1040us) client_negotiation.cc:240] Negotiation successful
0812 00:25:48.709289 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1452,"thread_start_us":1334,"threads_started":1}
I20260812 00:25:48.710813 6787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:48.700484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:33301 (local address 127.0.0.1:49050)
0812 00:25:48.701320 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:48.701340 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:48.701466 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:48.702798 (+ 1332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:48.702804 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:48.702829 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:48.703234 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:48.703247 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.705336 (+ 2089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.705341 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:48.707536 (+ 2195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:48.707553 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.709646 (+ 2093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.709657 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:48.710104 (+ 447us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:48.710139 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 00:25:48.710231 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 00:25:48.710369 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"spinlock_wait_cycles":768,"thread_start_us":1147,"threads_started":1}
I20260812 00:25:48.711575 6788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:48.701296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49050 (local address 127.18.163.194:33301)
0812 00:25:48.702193 (+ 897us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:48.702204 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:48.702233 (+ 29us) server_negotiation.cc:407] Connection header received
0812 00:25:48.702326 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:48.702334 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:48.702570 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:48.703422 (+ 852us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:48.703603 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.705116 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.707755 (+ 2639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:48.709343 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:48.709529 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:48.709741 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:48.711059 (+ 1318us) server_negotiation.cc:299] Negotiation successful
0812 00:25:48.711247 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":726,"thread_start_us":1413,"threads_started":1}
I20260812 00:25:48.713732 6694 tablet_service.cc:1467] Processing CreateTablet for tablet ae96e1e0f58146e998ce5679e16aebab (DEFAULT_TABLE table=test-table [id=ab82b8e37a584170b417a3e812803414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:25:48.713807 6390 tablet_service.cc:1467] Processing CreateTablet for tablet ae96e1e0f58146e998ce5679e16aebab (DEFAULT_TABLE table=test-table [id=ab82b8e37a584170b417a3e812803414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:25:48.715194 6694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae96e1e0f58146e998ce5679e16aebab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:25:48.715312 6390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae96e1e0f58146e998ce5679e16aebab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:25:48.715402 6542 tablet_service.cc:1467] Processing CreateTablet for tablet ae96e1e0f58146e998ce5679e16aebab (DEFAULT_TABLE table=test-table [id=ab82b8e37a584170b417a3e812803414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:25:48.716953 6542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae96e1e0f58146e998ce5679e16aebab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:25:48.730696 6789 tablet_bootstrap.cc:492] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3: Bootstrap starting.
I20260812 00:25:48.733032 6790 tablet_bootstrap.cc:492] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6: Bootstrap starting.
I20260812 00:25:48.735062 6789 tablet_bootstrap.cc:654] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3: Neither blocks nor log segments found. Creating new log.
I20260812 00:25:48.736553 6789 log.cc:824] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3: Log is configured to *not* fsync() on all Append() calls
I20260812 00:25:48.736994 6790 tablet_bootstrap.cc:654] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6: Neither blocks nor log segments found. Creating new log.
I20260812 00:25:48.738698 6790 log.cc:824] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:25:48.739032 6791 tablet_bootstrap.cc:492] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541: Bootstrap starting.
I20260812 00:25:48.742626 6789 tablet_bootstrap.cc:492] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3: No bootstrap required, opened a new log
I20260812 00:25:48.742928 6789 ts_tablet_manager.cc:1397] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.006s
I20260812 00:25:48.743052 6790 tablet_bootstrap.cc:492] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6: No bootstrap required, opened a new log
I20260812 00:25:48.743347 6790 ts_tablet_manager.cc:1397] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260812 00:25:48.743364 6791 tablet_bootstrap.cc:654] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541: Neither blocks nor log segments found. Creating new log.
I20260812 00:25:48.744704 6791 log.cc:824] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541: Log is configured to *not* fsync() on all Append() calls
I20260812 00:25:48.748355 6791 tablet_bootstrap.cc:492] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541: No bootstrap required, opened a new log
I20260812 00:25:48.748682 6791 ts_tablet_manager.cc:1397] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260812 00:25:48.752490 6790 raft_consensus.cc:348] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e8238daa104176be83bdbdf70fa4c6" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39077 } } peers { permanent_uuid: "9663d4e87adc4bd2b7ce18fbfcb9d9a3" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44427 } } peers { permanent_uuid: "98e4317bb6174b428493a91f23b7d541" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 33301 } }
I20260812 00:25:48.753012 6790 raft_consensus.cc:374] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:25:48.753125 6790 raft_consensus.cc:729] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8e8238daa104176be83bdbdf70fa4c6, State: Initialized, Role: FOLLOWER
I20260812 00:25:48.753633 6789 raft_consensus.cc:348] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e8238daa104176be83bdbdf70fa4c6" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39077 } } peers { permanent_uuid: "9663d4e87adc4bd2b7ce18fbfcb9d9a3" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44427 } } peers { permanent_uuid: "98e4317bb6174b428493a91f23b7d541" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 33301 } }
I20260812 00:25:48.753876 6790 consensus_queue.cc:260] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e8238daa104176be83bdbdf70fa4c6" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39077 } } peers { permanent_uuid: "9663d4e87adc4bd2b7ce18fbfcb9d9a3" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44427 } } peers { permanent_uuid: "98e4317bb6174b428493a91f23b7d541" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 33301 } }
I20260812 00:25:48.754091 6789 raft_consensus.cc:374] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:25:48.754272 6789 raft_consensus.cc:729] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9663d4e87adc4bd2b7ce18fbfcb9d9a3, State: Initialized, Role: FOLLOWER
I20260812 00:25:48.754920 6789 consensus_queue.cc:260] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e8238daa104176be83bdbdf70fa4c6" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39077 } } peers { permanent_uuid: "9663d4e87adc4bd2b7ce18fbfcb9d9a3" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44427 } } peers { permanent_uuid: "98e4317bb6174b428493a91f23b7d541" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 33301 } }
I20260812 00:25:48.756034 6790 ts_tablet_manager.cc:1428] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260812 00:25:48.757170 6766 heartbeater.cc:503] Master 127.18.163.254:34513 was elected leader, sending a full tablet report...
I20260812 00:25:48.757910 6789 ts_tablet_manager.cc:1428] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260812 00:25:48.760408 6791 raft_consensus.cc:348] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e8238daa104176be83bdbdf70fa4c6" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39077 } } peers { permanent_uuid: "9663d4e87adc4bd2b7ce18fbfcb9d9a3" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44427 } } peers { permanent_uuid: "98e4317bb6174b428493a91f23b7d541" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 33301 } }
I20260812 00:25:48.760936 6791 raft_consensus.cc:374] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:25:48.761049 6791 raft_consensus.cc:729] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98e4317bb6174b428493a91f23b7d541, State: Initialized, Role: FOLLOWER
I20260812 00:25:48.761772 6791 consensus_queue.cc:260] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e8238daa104176be83bdbdf70fa4c6" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39077 } } peers { permanent_uuid: "9663d4e87adc4bd2b7ce18fbfcb9d9a3" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44427 } } peers { permanent_uuid: "98e4317bb6174b428493a91f23b7d541" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 33301 } }
I20260812 00:25:48.766393 6615 heartbeater.cc:503] Master 127.18.163.254:34513 was elected leader, sending a full tablet report...
I20260812 00:25:48.767226 6791 ts_tablet_manager.cc:1428] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541: Time spent starting tablet: real 0.018s user 0.011s sys 0.009s
W20260812 00:25:48.774379 6616 tablet.cc:2369] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:25:48.868770 6768 tablet.cc:2369] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:25:48.923487 6466 tablet.cc:2369] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:25:49.119875 6796 raft_consensus.cc:482] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:25:49.120270 6796 raft_consensus.cc:504] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e8238daa104176be83bdbdf70fa4c6" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39077 } } peers { permanent_uuid: "9663d4e87adc4bd2b7ce18fbfcb9d9a3" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44427 } } peers { permanent_uuid: "98e4317bb6174b428493a91f23b7d541" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 33301 } }
I20260812 00:25:49.122280 6796 leader_election.cc:288] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9663d4e87adc4bd2b7ce18fbfcb9d9a3 (127.18.163.195:44427), 98e4317bb6174b428493a91f23b7d541 (127.18.163.194:33301)
I20260812 00:25:49.131731 6788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:49.123143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:53049 (local address 127.18.163.194:33301)
0812 00:25:49.123369 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:49.123376 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:49.123723 (+ 347us) server_negotiation.cc:407] Connection header received
0812 00:25:49.123925 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:49.123931 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:49.124015 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:49.124127 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:49.124906 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:49.126013 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:49.129063 (+ 3050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:49.130418 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:49.130606 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:49.130682 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:49.131299 (+ 617us) server_negotiation.cc:299] Negotiation successful
0812 00:25:49.131446 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 00:25:49.131731 6786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:49.122620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:39109 (local address 127.18.163.195:44427)
0812 00:25:49.122856 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:49.122866 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:49.123615 (+ 749us) server_negotiation.cc:407] Connection header received
0812 00:25:49.123867 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:49.123871 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:49.123934 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:49.124037 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:49.124652 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:49.125825 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:49.129070 (+ 3245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:49.130419 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:49.130600 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:49.130682 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:49.131299 (+ 617us) server_negotiation.cc:299] Negotiation successful
0812 00:25:49.131446 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:25:49.132031 6799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:49.122528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:44427 (local address 127.18.163.193:39109)
0812 00:25:49.123471 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:49.123489 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:49.123704 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:49.124055 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:49.124060 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:49.124085 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:49.124484 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:49.124494 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:49.125987 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:49.125995 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:49.128848 (+ 2853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:49.128868 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:49.130752 (+ 1884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:49.130757 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:49.131012 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:49.131138 (+ 126us) client_negotiation.cc:769] Sending connection context
0812 00:25:49.131250 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 00:25:49.131484 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"mutex_wait_us":325,"thread_start_us":570,"threads_started":1}
I20260812 00:25:49.132055 6800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:49.122716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:33301 (local address 127.18.163.193:53049)
0812 00:25:49.123616 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:49.123639 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:49.123779 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:49.124149 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:49.124153 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:49.124194 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:49.124728 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:49.124743 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:49.126146 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:49.126169 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:49.128848 (+ 2679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:49.128868 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:49.130742 (+ 1874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:49.130749 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:49.131009 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:49.131139 (+ 130us) client_negotiation.cc:769] Sending connection context
0812 00:25:49.131250 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 00:25:49.131484 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"mutex_wait_us":224,"spinlock_wait_cycles":30592,"thread_start_us":660,"threads_started":1}
I20260812 00:25:49.133152 6716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae96e1e0f58146e998ce5679e16aebab" candidate_uuid: "a8e8238daa104176be83bdbdf70fa4c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9663d4e87adc4bd2b7ce18fbfcb9d9a3" is_pre_election: true
I20260812 00:25:49.133160 6565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae96e1e0f58146e998ce5679e16aebab" candidate_uuid: "a8e8238daa104176be83bdbdf70fa4c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e4317bb6174b428493a91f23b7d541" is_pre_election: true
I20260812 00:25:49.133718 6716 raft_consensus.cc:2454] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8e8238daa104176be83bdbdf70fa4c6 in term 0.
I20260812 00:25:49.133713 6565 raft_consensus.cc:2454] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8e8238daa104176be83bdbdf70fa4c6 in term 0.
I20260812 00:25:49.134471 6341 leader_election.cc:302] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 9663d4e87adc4bd2b7ce18fbfcb9d9a3, 98e4317bb6174b428493a91f23b7d541, a8e8238daa104176be83bdbdf70fa4c6; no voters:
I20260812 00:25:49.134975 6796 raft_consensus.cc:2781] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:25:49.135166 6796 raft_consensus.cc:482] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:25:49.135298 6796 raft_consensus.cc:3037] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:25:49.137724 6796 raft_consensus.cc:504] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e8238daa104176be83bdbdf70fa4c6" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39077 } } peers { permanent_uuid: "9663d4e87adc4bd2b7ce18fbfcb9d9a3" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44427 } } peers { permanent_uuid: "98e4317bb6174b428493a91f23b7d541" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 33301 } }
I20260812 00:25:49.138523 6796 leader_election.cc:288] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [CANDIDATE]: Term 1 election: Requested vote from peers 9663d4e87adc4bd2b7ce18fbfcb9d9a3 (127.18.163.195:44427), 98e4317bb6174b428493a91f23b7d541 (127.18.163.194:33301)
I20260812 00:25:49.139079 6565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae96e1e0f58146e998ce5679e16aebab" candidate_uuid: "a8e8238daa104176be83bdbdf70fa4c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e4317bb6174b428493a91f23b7d541"
I20260812 00:25:49.139079 6716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae96e1e0f58146e998ce5679e16aebab" candidate_uuid: "a8e8238daa104176be83bdbdf70fa4c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9663d4e87adc4bd2b7ce18fbfcb9d9a3"
I20260812 00:25:49.139323 6716 raft_consensus.cc:3037] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:25:49.139323 6565 raft_consensus.cc:3037] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:25:49.142881 6565 raft_consensus.cc:2454] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8e8238daa104176be83bdbdf70fa4c6 in term 1.
I20260812 00:25:49.142881 6716 raft_consensus.cc:2454] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8e8238daa104176be83bdbdf70fa4c6 in term 1.
I20260812 00:25:49.143407 6338 leader_election.cc:302] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98e4317bb6174b428493a91f23b7d541, a8e8238daa104176be83bdbdf70fa4c6; no voters:
I20260812 00:25:49.143765 6796 raft_consensus.cc:2781] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:25:49.144236 6796 raft_consensus.cc:686] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [term 1 LEADER]: Becoming Leader. State: Replica: a8e8238daa104176be83bdbdf70fa4c6, State: Running, Role: LEADER
I20260812 00:25:49.144752 6796 consensus_queue.cc:237] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e8238daa104176be83bdbdf70fa4c6" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39077 } } peers { permanent_uuid: "9663d4e87adc4bd2b7ce18fbfcb9d9a3" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44427 } } peers { permanent_uuid: "98e4317bb6174b428493a91f23b7d541" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 33301 } }
I20260812 00:25:49.150107 6245 catalog_manager.cc:5495] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8e8238daa104176be83bdbdf70fa4c6 (127.18.163.193). New cstate: current_term: 1 leader_uuid: "a8e8238daa104176be83bdbdf70fa4c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e8238daa104176be83bdbdf70fa4c6" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 39077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9663d4e87adc4bd2b7ce18fbfcb9d9a3" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98e4317bb6174b428493a91f23b7d541" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 33301 } health_report { overall_health: UNKNOWN } } }
I20260812 00:25:49.178779 6780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:49.172095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38964 (local address 127.18.163.193:39077)
0812 00:25:49.172332 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:49.172338 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:49.172885 (+ 547us) server_negotiation.cc:407] Connection header received
0812 00:25:49.173108 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:49.173117 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:49.173262 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:49.173446 (+ 184us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:25:49.174006 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:49.174869 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:49.176511 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:49.176931 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:49.177044 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:49.177621 (+ 577us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:25:49.178239 (+ 618us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:25:49.178365 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:49.178480 (+ 115us) server_negotiation.cc:299] Negotiation successful
0812 00:25:49.178558 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260812 00:25:49.188928 6716 raft_consensus.cc:1261] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3 [term 1 FOLLOWER]: Refusing update from remote peer a8e8238daa104176be83bdbdf70fa4c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:25:49.188928 6565 raft_consensus.cc:1261] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541 [term 1 FOLLOWER]: Refusing update from remote peer a8e8238daa104176be83bdbdf70fa4c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:25:49.190200 6796 consensus_queue.cc:1035] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9663d4e87adc4bd2b7ce18fbfcb9d9a3" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 44427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:25:49.190600 6801 consensus_queue.cc:1035] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98e4317bb6174b428493a91f23b7d541" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 33301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:25:49.202750 6808 mvcc.cc:205] Tried to move back new op lower bound from 7317480854263848960 to 7317480854101233664. Current Snapshot: MvccSnapshot[applied={T|T < 7317480854263848960}]
I20260812 00:25:49.203433 6806 mvcc.cc:205] Tried to move back new op lower bound from 7317480854263848960 to 7317480854101233664. Current Snapshot: MvccSnapshot[applied={T|T < 7317480854263848960}]
I20260812 00:25:49.219139 6245 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:25:49.219393 6245 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:25:49.223448 6245 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9efd57bc0a2d4fdaa4f7cef37884a86a: Sending DeleteTablet for 3 replicas of tablet ae96e1e0f58146e998ce5679e16aebab
I20260812 00:25:49.224893 6694 tablet_service.cc:1514] Processing DeleteTablet for tablet ae96e1e0f58146e998ce5679e16aebab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:25:49 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:56816
I20260812 00:25:49.225241 6542 tablet_service.cc:1514] Processing DeleteTablet for tablet ae96e1e0f58146e998ce5679e16aebab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:25:49 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:49050
I20260812 00:25:49.225813 6390 tablet_service.cc:1514] Processing DeleteTablet for tablet ae96e1e0f58146e998ce5679e16aebab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:25:49 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:38952
I20260812 00:25:49.226137 6816 tablet_replica.cc:330] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3: stopping tablet replica
I20260812 00:25:49.226691 6816 raft_consensus.cc:2229] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:25:49.227346 6816 raft_consensus.cc:2258] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:25:49.227981 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 6321
I20260812 00:25:49.230582 6816 ts_tablet_manager.cc:1905] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:25:49.240885 6818 tablet_replica.cc:330] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6: stopping tablet replica
I20260812 00:25:49.241632 6818 raft_consensus.cc:2229] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:25:49.242530 6818 raft_consensus.cc:2258] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:25:49.244414 6817 tablet_replica.cc:330] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541: stopping tablet replica
I20260812 00:25:49.244923 6817 raft_consensus.cc:2229] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:25:49.245087 6818 ts_tablet_manager.cc:1905] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:25:49.245512 6817 raft_consensus.cc:2258] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:25:49.248014 6817 ts_tablet_manager.cc:1905] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:25:49.253489 6818 ts_tablet_manager.cc:1918] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:25:49.253741 6818 log.cc:1196] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/ae96e1e0f58146e998ce5679e16aebab
I20260812 00:25:49.254369 6818 ts_tablet_manager.cc:1939] T ae96e1e0f58146e998ce5679e16aebab P a8e8238daa104176be83bdbdf70fa4c6: Deleting consensus metadata
Aug 12 00:25:49 dist-test-slave-njxd krb5kdc[6195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:25:49.256491 6817 ts_tablet_manager.cc:1918] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:25:49.256527 6226 catalog_manager.cc:4841] TS a8e8238daa104176be83bdbdf70fa4c6 (127.18.163.193:39077): tablet ae96e1e0f58146e998ce5679e16aebab (table test-table [id=ab82b8e37a584170b417a3e812803414]) successfully deleted
I20260812 00:25:49.256721 6817 log.cc:1196] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/ae96e1e0f58146e998ce5679e16aebab
I20260812 00:25:49.257314 6817 ts_tablet_manager.cc:1939] T ae96e1e0f58146e998ce5679e16aebab P 98e4317bb6174b428493a91f23b7d541: Deleting consensus metadata
I20260812 00:25:49.240990 6816 ts_tablet_manager.cc:1918] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:25:49.257921 6816 log.cc:1196] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/ae96e1e0f58146e998ce5679e16aebab
I20260812 00:25:49.258571 6816 ts_tablet_manager.cc:1939] T ae96e1e0f58146e998ce5679e16aebab P 9663d4e87adc4bd2b7ce18fbfcb9d9a3: Deleting consensus metadata
I20260812 00:25:49.259735 6226 catalog_manager.cc:4841] TS 98e4317bb6174b428493a91f23b7d541 (127.18.163.194:33301): tablet ae96e1e0f58146e998ce5679e16aebab (table test-table [id=ab82b8e37a584170b417a3e812803414]) successfully deleted
I20260812 00:25:49.260418 6230 catalog_manager.cc:4841] TS 9663d4e87adc4bd2b7ce18fbfcb9d9a3 (127.18.163.195:44427): tablet ae96e1e0f58146e998ce5679e16aebab (table test-table [id=ab82b8e37a584170b417a3e812803414]) successfully deleted
I20260812 00:25:49.265866 6780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:49.231159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38968 (local address 127.18.163.193:39077)
0812 00:25:49.231407 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:49.231414 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:49.243680 (+ 12266us) server_negotiation.cc:407] Connection header received
0812 00:25:49.243934 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:49.243942 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:49.244045 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:49.244183 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:49.246671 (+ 2488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:49.248011 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:49.250423 (+ 2412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:49.251197 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:49.251302 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:49.258426 (+ 7124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:49.258443 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:49.258464 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:49.258531 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:49.262490 (+ 3959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:49.263484 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:49.263495 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:49.263497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:49.263687 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:49.264120 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:49.264125 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:49.264128 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:49.264506 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:49.264845 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:49.265192 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 00:25:49.265448 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 00:25:49.266570 6460 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:49.368090 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 6321
I20260812 00:25:49.392223 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 6472
Aug 12 00:25:49 dist-test-slave-njxd krb5kdc[6195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
I20260812 00:25:49.408619 6788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:49.393010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49066 (local address 127.18.163.194:33301)
0812 00:25:49.393209 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:49.393214 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:49.393234 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:25:49.393371 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:49.393375 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:49.393440 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:49.393525 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:49.394948 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:49.395673 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:49.397060 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:49.397471 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:49.397639 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:49.402513 (+ 4874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:49.402533 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:49.402550 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:49.402599 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:49.405791 (+ 3192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:49.406573 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:49.406581 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:49.406584 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:49.406734 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:49.407093 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:49.407097 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:49.407099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:49.407517 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:49.407769 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:49.408000 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 00:25:49.408212 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 00:25:49.409343 6610 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:49.502146 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 6472
I20260812 00:25:49.525663 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 6622
Aug 12 00:25:49 dist-test-slave-njxd krb5kdc[6195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:25:49.541887 6786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:49.526480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56822 (local address 127.18.163.195:44427)
0812 00:25:49.526718 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:49.526729 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:49.526752 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:25:49.526894 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:49.526904 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:49.526981 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:49.527068 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:49.528407 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:49.529150 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:49.530600 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:49.530999 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:49.531096 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:49.535925 (+ 4829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:49.535945 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:49.535964 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:49.536009 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:49.538869 (+ 2860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:49.539649 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:49.539657 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:49.539659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:49.539820 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:49.540280 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:49.540285 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:49.540290 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:49.540750 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:49.541002 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:49.541303 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 00:25:49.541508 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 00:25:49.542675 6761 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:49.634346 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 6622
I20260812 00:25:49.657419 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 6210
I20260812 00:25:49.658814 6287 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:49.776327 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 6210
2026-08-12T00:25:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (5247 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T00:25:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:25:49Z Disabled control of system clock
I20260812 00:25:49.889910 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:43857
--webserver_interface=127.18.163.254
--webserver_port=0
--builtin_ntp_servers=127.18.163.212:46713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:43857
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:25:50.263839 6829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:50.264165 6829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:50.264302 6829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:50.272105 6829 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:25:50.272243 6829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:50.272346 6829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:50.272449 6829 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:25:50.272528 6829 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:25:50.282452 6829 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:46713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:43857
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:43857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:50.283905 6829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:50.286012 6829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:50.298270 6838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:50.298314 6835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:50.298424 6836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:50.299068 6829 server_base.cc:1034] running on GCE node
I20260812 00:25:50.299978 6829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:50.301477 6829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:50.302707 6829 hybrid_clock.cc:648] HybridClock initialized: now 1786494350302658 us; error 41 us; skew 500 ppm
I20260812 00:25:50.303118 6829 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:25:50.305685 6829 webserver.cc:460] Webserver started at http://127.18.163.254:46487/ using document root <none> and password file <none>
I20260812 00:25:50.306478 6829 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:50.306608 6829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:50.306994 6829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:25:50.310274 6829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "25e053526c684270a56f45cd5bfed935"
format_stamp: "Formatted at 2026-08-12 00:25:50 on dist-test-slave-njxd"
server_key: "1aa12a84e2de1f7448800cf049f15000"
server_key_iv: "215e62be60688af7da7168bea1d41932"
server_key_version: "encryptionkey@0"
I20260812 00:25:50.311167 6829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "25e053526c684270a56f45cd5bfed935"
format_stamp: "Formatted at 2026-08-12 00:25:50 on dist-test-slave-njxd"
server_key: "1aa12a84e2de1f7448800cf049f15000"
server_key_iv: "215e62be60688af7da7168bea1d41932"
server_key_version: "encryptionkey@0"
I20260812 00:25:50.316875 6829 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 00:25:50.320904 6845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:50.322456 6829 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 00:25:50.322659 6829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "25e053526c684270a56f45cd5bfed935"
format_stamp: "Formatted at 2026-08-12 00:25:50 on dist-test-slave-njxd"
server_key: "1aa12a84e2de1f7448800cf049f15000"
server_key_iv: "215e62be60688af7da7168bea1d41932"
server_key_version: "encryptionkey@0"
I20260812 00:25:50.322926 6829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:50.346187 6829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:50.347249 6829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:50.347591 6829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:50.367806 6829 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:43857
I20260812 00:25:50.367826 6903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:43857 every 8 connection(s)
I20260812 00:25:50.369333 6829 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:25:50.373330 6904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:25:50.377848 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 6829
I20260812 00:25:50.378048 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:25:50.378641 19087 external_mini_cluster.cc:1428] Setting key 308b00aec8f4355e62aa26da63db7a2a
I20260812 00:25:50.387722 6904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935: Bootstrap starting.
I20260812 00:25:50.391553 6904 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935: Neither blocks nor log segments found. Creating new log.
I20260812 00:25:50.392865 6904 log.cc:824] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935: Log is configured to *not* fsync() on all Append() calls
I20260812 00:25:50.394310 6907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:50.380915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44874 (local address 127.18.163.254:43857)
0812 00:25:50.382086 (+ 1171us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:50.382098 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:50.382146 (+ 48us) server_negotiation.cc:407] Connection header received
0812 00:25:50.383840 (+ 1694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:50.383867 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:50.384462 (+ 595us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:50.384949 (+ 487us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:50.385687 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:50.387014 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:50.388692 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:50.389520 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:50.389850 (+ 330us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:50.391219 (+ 1369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:50.391228 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:50.391244 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:25:50.391956 (+ 712us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:50.392073 (+ 117us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:25:50.392098 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:50.392227 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:50.392513 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 00:25:50.392871 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":424,"threads_started":1}
I20260812 00:25:50.396565 6904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935: No bootstrap required, opened a new log
I20260812 00:25:50.405432 6904 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e053526c684270a56f45cd5bfed935" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 43857 } }
I20260812 00:25:50.405930 6904 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:25:50.406014 6904 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25e053526c684270a56f45cd5bfed935, State: Initialized, Role: FOLLOWER
I20260812 00:25:50.406569 6904 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e053526c684270a56f45cd5bfed935" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 43857 } }
I20260812 00:25:50.406859 6904 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:25:50.407020 6904 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:25:50.407269 6904 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:25:50.409955 6904 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e053526c684270a56f45cd5bfed935" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 43857 } }
I20260812 00:25:50.410715 6904 leader_election.cc:302] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25e053526c684270a56f45cd5bfed935; no voters:
I20260812 00:25:50.411432 6904 leader_election.cc:288] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:25:50.411624 6909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:25:50.412408 6909 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [term 1 LEADER]: Becoming Leader. State: Replica: 25e053526c684270a56f45cd5bfed935, State: Running, Role: LEADER
I20260812 00:25:50.412998 6909 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e053526c684270a56f45cd5bfed935" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 43857 } }
I20260812 00:25:50.413983 6904 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:25:50.416426 6910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25e053526c684270a56f45cd5bfed935" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e053526c684270a56f45cd5bfed935" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 43857 } } }
I20260812 00:25:50.416988 6910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [sys.catalog]: This master's current role is: LEADER
I20260812 00:25:50.417836 6911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25e053526c684270a56f45cd5bfed935. Latest consensus state: current_term: 1 leader_uuid: "25e053526c684270a56f45cd5bfed935" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e053526c684270a56f45cd5bfed935" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 43857 } } }
I20260812 00:25:50.418239 6911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935 [sys.catalog]: This master's current role is: LEADER
I20260812 00:25:50.419008 6919 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:25:50.425395 6919 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:25:50.438788 6919 catalog_manager.cc:1347] Generated new cluster ID: b965417cdfc242efaf022e2bdd2109fe
I20260812 00:25:50.438946 6919 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:25:50.456854 6919 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:25:50.458885 6919 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:25:50.478516 6919 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935: Generated new TSK 0
I20260812 00:25:50.479724 6919 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:25:50.500355 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:43857
--builtin_ntp_servers=127.18.163.212:46713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:25:50.905107 6932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:50.905654 6932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:50.905844 6932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:50.914183 6932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:50.914294 6932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:50.914484 6932 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:25:50.925103 6932 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:46713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:43857
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:50.926646 6932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:50.928716 6932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:50.943291 6938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:50.943193 6937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:50.943320 6941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:50.947202 6932 server_base.cc:1034] running on GCE node
I20260812 00:25:50.947917 6932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:50.948994 6932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:50.950266 6932 hybrid_clock.cc:648] HybridClock initialized: now 1786494350950216 us; error 66 us; skew 500 ppm
I20260812 00:25:50.950625 6932 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:25:50.953094 6932 webserver.cc:460] Webserver started at http://127.18.163.193:38159/ using document root <none> and password file <none>
I20260812 00:25:50.953961 6932 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:50.954100 6932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:50.954442 6932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:25:50.957731 6932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "49790420257f4a3bb661d925e73bd580"
format_stamp: "Formatted at 2026-08-12 00:25:50 on dist-test-slave-njxd"
server_key: "a1cdc8c86cd0996285868e1dc781acc6"
server_key_iv: "01fefdb1f07e61fecc57792d84501361"
server_key_version: "encryptionkey@0"
I20260812 00:25:50.958616 6932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "49790420257f4a3bb661d925e73bd580"
format_stamp: "Formatted at 2026-08-12 00:25:50 on dist-test-slave-njxd"
server_key: "a1cdc8c86cd0996285868e1dc781acc6"
server_key_iv: "01fefdb1f07e61fecc57792d84501361"
server_key_version: "encryptionkey@0"
I20260812 00:25:50.964612 6932 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260812 00:25:50.968521 6950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:50.970182 6932 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:25:50.970393 6932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "49790420257f4a3bb661d925e73bd580"
format_stamp: "Formatted at 2026-08-12 00:25:50 on dist-test-slave-njxd"
server_key: "a1cdc8c86cd0996285868e1dc781acc6"
server_key_iv: "01fefdb1f07e61fecc57792d84501361"
server_key_version: "encryptionkey@0"
I20260812 00:25:50.970641 6932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:50.984828 6932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:50.985971 6932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:50.986331 6932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:50.987430 6932 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:25:50.989058 6932 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:25:50.989197 6932 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:50.989342 6932 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:25:50.989435 6932 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:51.025085 6932 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:34291
I20260812 00:25:51.025139 7078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:34291 every 8 connection(s)
I20260812 00:25:51.026700 6932 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:25:51.036648 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 6932
I20260812 00:25:51.036870 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:25:51.037369 19087 external_mini_cluster.cc:1428] Setting key 8be7e2e246fab348afaca437edab86ec
I20260812 00:25:51.040553 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:43857
--builtin_ntp_servers=127.18.163.212:46713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:25:51.040838 7082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:51.029771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:40753 (local address 127.18.163.254:43857)
0812 00:25:51.030280 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:51.030285 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:51.031329 (+ 1044us) server_negotiation.cc:407] Connection header received
0812 00:25:51.033315 (+ 1986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:51.033321 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:51.033420 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:51.033560 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:51.034837 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:51.035594 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:51.037447 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:51.037984 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:51.038145 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:51.039890 (+ 1745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:51.039896 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:51.039907 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:25:51.039929 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:51.039972 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:25:51.039984 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:51.040093 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:51.040352 (+ 259us) server_negotiation.cc:299] Negotiation successful
0812 00:25:51.040463 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":273,"threads_started":1}
I20260812 00:25:51.042092 7084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:51.030148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:43857 (local address 127.18.163.193:40753)
0812 00:25:51.031140 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:51.031193 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:51.032998 (+ 1805us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:51.033854 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:51.033865 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:51.033973 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:25:51.034636 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:51.034656 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:51.035779 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:51.035784 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:51.037280 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:51.037294 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:51.038258 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:51.038266 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:51.038574 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:51.039459 (+ 885us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:25:51.039463 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:25:51.039536 (+ 73us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:25:51.039667 (+ 131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:25:51.040091 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:25:51.040106 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:25:51.040116 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 00:25:51.040346 (+ 230us) client_negotiation.cc:240] Negotiation successful
0812 00:25:51.040821 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":309,"threads_started":1}
I20260812 00:25:51.043970 7080 heartbeater.cc:347] Connected to a master server at 127.18.163.254:43857
I20260812 00:25:51.044305 7080 heartbeater.cc:464] Registering TS with master...
I20260812 00:25:51.045132 7080 heartbeater.cc:511] Master 127.18.163.254:43857 requested a full tablet report, sending...
I20260812 00:25:51.047708 6865 ts_manager.cc:194] Registered new tserver with Master: 49790420257f4a3bb661d925e73bd580 (127.18.163.193:34291)
I20260812 00:25:51.050001 6865 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.163.193:40753
W20260812 00:25:51.424227 7085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:51.424602 7085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:51.424767 7085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:51.432448 7085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:51.432626 7085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:51.432813 7085 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:25:51.442662 7085 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:46713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:43857
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:51.444133 7085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:51.446161 7085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:51.460657 7093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:51.460827 7091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:51.460651 7090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:51.461604 7085 server_base.cc:1034] running on GCE node
I20260812 00:25:51.462268 7085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:51.463285 7085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:51.464515 7085 hybrid_clock.cc:648] HybridClock initialized: now 1786494351464469 us; error 44 us; skew 500 ppm
I20260812 00:25:51.464843 7085 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:25:51.467422 7085 webserver.cc:460] Webserver started at http://127.18.163.194:38603/ using document root <none> and password file <none>
I20260812 00:25:51.468232 7085 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:51.468369 7085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:51.468750 7085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:25:51.472591 7085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "513485a1ffff41cb8ef7babd7a8f1f30"
format_stamp: "Formatted at 2026-08-12 00:25:51 on dist-test-slave-njxd"
server_key: "9827bd37abd322503d98cc607cabddb1"
server_key_iv: "f054d97cf91d8f661a005ef2c4f2a403"
server_key_version: "encryptionkey@0"
I20260812 00:25:51.473501 7085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "513485a1ffff41cb8ef7babd7a8f1f30"
format_stamp: "Formatted at 2026-08-12 00:25:51 on dist-test-slave-njxd"
server_key: "9827bd37abd322503d98cc607cabddb1"
server_key_iv: "f054d97cf91d8f661a005ef2c4f2a403"
server_key_version: "encryptionkey@0"
I20260812 00:25:51.479872 7085 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:25:51.483862 7099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:51.485446 7085 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:25:51.485741 7085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "513485a1ffff41cb8ef7babd7a8f1f30"
format_stamp: "Formatted at 2026-08-12 00:25:51 on dist-test-slave-njxd"
server_key: "9827bd37abd322503d98cc607cabddb1"
server_key_iv: "f054d97cf91d8f661a005ef2c4f2a403"
server_key_version: "encryptionkey@0"
I20260812 00:25:51.486016 7085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:51.513895 7085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:51.514966 7085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:51.515307 7085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:51.516407 7085 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:25:51.518167 7085 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:25:51.518362 7085 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 00:25:51.518524 7085 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:25:51.518620 7085 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:51.555279 7085 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:36551
I20260812 00:25:51.555377 7222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:36551 every 8 connection(s)
I20260812 00:25:51.556752 7085 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:25:51.559563 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 7085
I20260812 00:25:51.559777 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:25:51.560242 19087 external_mini_cluster.cc:1428] Setting key b20d971d81f9087a17b2e64a5681f79b
I20260812 00:25:51.563700 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:43857
--builtin_ntp_servers=127.18.163.212:46713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:25:51.572028 7226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:51.559519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:56775 (local address 127.18.163.254:43857)
0812 00:25:51.562315 (+ 2796us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:51.562323 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:51.562345 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:25:51.564053 (+ 1708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:51.564061 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:51.564158 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:51.564284 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:51.565506 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:51.566760 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:51.568510 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:51.569246 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:51.569404 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:51.570987 (+ 1583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:51.570996 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:51.571003 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:25:51.571033 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:51.571092 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:25:51.571113 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:51.571213 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:51.571429 (+ 216us) server_negotiation.cc:299] Negotiation successful
0812 00:25:51.571552 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2639,"thread_start_us":2507,"threads_started":1}
I20260812 00:25:51.572990 7227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:51.560256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:43857 (local address 127.18.163.194:56775)
0812 00:25:51.561600 (+ 1344us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:51.561673 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:51.563698 (+ 2025us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:51.564518 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:51.564527 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:51.564630 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:25:51.565289 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:51.565308 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:51.566969 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:51.566974 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:51.568323 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:51.568339 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:51.569487 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:51.569492 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:51.569805 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:51.570619 (+ 814us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:25:51.570621 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:25:51.570672 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:25:51.570761 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:25:51.571215 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:25:51.571223 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:25:51.571229 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:25:51.571390 (+ 161us) client_negotiation.cc:240] Negotiation successful
0812 00:25:51.571738 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"thread_start_us":407,"threads_started":1}
I20260812 00:25:51.574740 7224 heartbeater.cc:347] Connected to a master server at 127.18.163.254:43857
I20260812 00:25:51.575143 7224 heartbeater.cc:464] Registering TS with master...
I20260812 00:25:51.576170 7224 heartbeater.cc:511] Master 127.18.163.254:43857 requested a full tablet report, sending...
I20260812 00:25:51.578042 6865 ts_manager.cc:194] Registered new tserver with Master: 513485a1ffff41cb8ef7babd7a8f1f30 (127.18.163.194:36551)
I20260812 00:25:51.578899 6865 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.163.194:56775
W20260812 00:25:51.938452 7228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:51.938766 7228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:51.938862 7228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:51.946581 7228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:51.946709 7228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:51.946825 7228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:25:51.956480 7228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:46713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:43857
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:51.957873 7228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:51.959800 7228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:51.974148 7233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:51.974195 7234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:51.974521 7236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:51.975446 7228 server_base.cc:1034] running on GCE node
I20260812 00:25:51.976192 7228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:51.977288 7228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:51.978541 7228 hybrid_clock.cc:648] HybridClock initialized: now 1786494351978469 us; error 70 us; skew 500 ppm
I20260812 00:25:51.978917 7228 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:25:51.984889 7228 webserver.cc:460] Webserver started at http://127.18.163.195:39881/ using document root <none> and password file <none>
I20260812 00:25:51.985787 7228 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:51.985944 7228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:51.986302 7228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:25:51.989676 7228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "bbc60f2e76f740818dcef0250750300a"
format_stamp: "Formatted at 2026-08-12 00:25:51 on dist-test-slave-njxd"
server_key: "e6dc8291238042bffde085f6dd9e8af1"
server_key_iv: "6f9ba8f9ccdd66fbc7249df8493c2da7"
server_key_version: "encryptionkey@0"
I20260812 00:25:51.990687 7228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "bbc60f2e76f740818dcef0250750300a"
format_stamp: "Formatted at 2026-08-12 00:25:51 on dist-test-slave-njxd"
server_key: "e6dc8291238042bffde085f6dd9e8af1"
server_key_iv: "6f9ba8f9ccdd66fbc7249df8493c2da7"
server_key_version: "encryptionkey@0"
I20260812 00:25:51.996695 7228 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260812 00:25:52.000871 7243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:52.002573 7228 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:25:52.002794 7228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "bbc60f2e76f740818dcef0250750300a"
format_stamp: "Formatted at 2026-08-12 00:25:51 on dist-test-slave-njxd"
server_key: "e6dc8291238042bffde085f6dd9e8af1"
server_key_iv: "6f9ba8f9ccdd66fbc7249df8493c2da7"
server_key_version: "encryptionkey@0"
I20260812 00:25:52.003052 7228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:52.022609 7228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:52.023633 7228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:52.023984 7228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:52.025240 7228 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:25:52.027025 7228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:25:52.027168 7228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:52.027333 7228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:25:52.027423 7228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:52.053748 7080 heartbeater.cc:503] Master 127.18.163.254:43857 was elected leader, sending a full tablet report...
I20260812 00:25:52.066378 7228 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:33377
I20260812 00:25:52.066445 7366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:33377 every 8 connection(s)
I20260812 00:25:52.067924 7228 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:25:52.072878 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 7228
I20260812 00:25:52.073074 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:25:52.073626 19087 external_mini_cluster.cc:1428] Setting key ccf6a8bb09aa6895d7caafdcf7b4a0db
I20260812 00:25:52.082298 7226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:52.070909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:44479 (local address 127.18.163.254:43857)
0812 00:25:52.071115 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:52.071120 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:52.072642 (+ 1522us) server_negotiation.cc:407] Connection header received
0812 00:25:52.075069 (+ 2427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:52.075075 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:52.075197 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:52.075320 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:52.076596 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.077389 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.079163 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.079594 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.079744 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:52.081314 (+ 1570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:52.081320 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:52.081323 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:25:52.081347 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:52.081381 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:25:52.081395 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:52.081498 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:52.081827 (+ 329us) server_negotiation.cc:299] Negotiation successful
0812 00:25:52.081950 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:25:52.083467 7369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:52.071448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:43857 (local address 127.18.163.195:44479)
0812 00:25:52.072449 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:52.072496 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:52.074761 (+ 2265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:52.075605 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:52.075615 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:52.075773 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:25:52.076415 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:52.076432 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.077618 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.077625 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:52.078980 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:52.078994 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.079882 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.079892 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:52.080137 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:52.080931 (+ 794us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:25:52.080933 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:25:52.080979 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:25:52.081070 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:25:52.081500 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:25:52.081516 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:25:52.081527 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:25:52.081813 (+ 286us) client_negotiation.cc:240] Negotiation successful
0812 00:25:52.082286 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":315,"threads_started":1}
I20260812 00:25:52.084992 7367 heartbeater.cc:347] Connected to a master server at 127.18.163.254:43857
I20260812 00:25:52.085336 7367 heartbeater.cc:464] Registering TS with master...
I20260812 00:25:52.086272 7367 heartbeater.cc:511] Master 127.18.163.254:43857 requested a full tablet report, sending...
I20260812 00:25:52.088060 6865 ts_manager.cc:194] Registered new tserver with Master: bbc60f2e76f740818dcef0250750300a (127.18.163.195:33377)
I20260812 00:25:52.089223 6865 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.163.195:44479
I20260812 00:25:52.089510 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:25:52.101310 7226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:52.094799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42722 (local address 127.18.163.254:43857)
0812 00:25:52.095061 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:52.095072 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:52.095431 (+ 359us) server_negotiation.cc:407] Connection header received
0812 00:25:52.095581 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:52.095585 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:52.095654 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:52.095752 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:52.096246 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.097225 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.098821 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.099263 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.099365 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:52.100451 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:52.100456 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:52.100460 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:25:52.100483 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:52.100519 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:25:52.100532 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:52.100607 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:52.100823 (+ 216us) server_negotiation.cc:299] Negotiation successful
0812 00:25:52.100916 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 00:25:52.105495 6865 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:25:52.112812 6865 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:25:52.152007 7380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:52.126637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:33377 (local address 127.0.0.1:57614)
0812 00:25:52.140416 (+ 13779us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:52.140489 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:52.140775 (+ 286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:52.143080 (+ 2305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:52.143089 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:52.143132 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:52.143821 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:52.143844 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.145913 (+ 2069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.145920 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:52.149008 (+ 3088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:52.149021 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.151064 (+ 2043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.151072 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:52.151269 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:52.151310 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 00:25:52.151373 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:25:52.151546 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11890,"mutex_wait_us":162,"thread_start_us":12571,"threads_started":1}
I20260812 00:25:52.152529 7383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:52.126857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:36551 (local address 127.0.0.1:43812)
0812 00:25:52.143116 (+ 16259us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:52.143136 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:52.143291 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:52.144274 (+ 983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:52.144279 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:52.144308 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:52.144730 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:52.144744 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.146484 (+ 1740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.146489 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:52.148971 (+ 2482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:52.148988 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.151716 (+ 2728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.151723 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:52.151910 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:52.151954 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 00:25:52.152058 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 00:25:52.152190 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16106,"mutex_wait_us":103,"thread_start_us":16708,"threads_started":1}
I20260812 00:25:52.153082 7385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:52.127864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37736 (local address 127.18.163.193:34291)
0812 00:25:52.142598 (+ 14734us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:52.142607 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:52.144110 (+ 1503us) server_negotiation.cc:407] Connection header received
0812 00:25:52.144449 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:52.144458 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:52.144686 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:52.144848 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:52.145865 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.147106 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.149560 (+ 2454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.150626 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.150865 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:52.151131 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:52.151507 (+ 376us) server_negotiation.cc:299] Negotiation successful
0812 00:25:52.151712 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14551,"thread_start_us":14442,"threads_started":1}
I20260812 00:25:52.153232 7382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:52.126977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57614 (local address 127.18.163.195:33377)
0812 00:25:52.142232 (+ 15255us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:52.142243 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:52.142290 (+ 47us) server_negotiation.cc:407] Connection header received
0812 00:25:52.142407 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:52.142418 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:52.142754 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:52.143741 (+ 987us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:52.144064 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.145758 (+ 1694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.149245 (+ 3487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.150816 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.152366 (+ 1550us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:52.152595 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:52.152674 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 00:25:52.152843 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15062,"thread_start_us":14894,"threads_started":1}
I20260812 00:25:52.153275 7384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:52.127609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43812 (local address 127.18.163.194:36551)
0812 00:25:52.141645 (+ 14036us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:52.141659 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:52.143291 (+ 1632us) server_negotiation.cc:407] Connection header received
0812 00:25:52.143478 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:52.143489 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:52.143755 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:52.143968 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:52.144946 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.146328 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.149716 (+ 3388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.151193 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.151354 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:52.151564 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:52.152761 (+ 1197us) server_negotiation.cc:299] Negotiation successful
0812 00:25:52.152917 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13807,"thread_start_us":13547,"threads_started":1}
I20260812 00:25:52.153028 7381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:52.127236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:34291 (local address 127.0.0.1:37736)
0812 00:25:52.143975 (+ 16739us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:52.143999 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:52.144247 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:52.145283 (+ 1036us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:52.145288 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:52.145314 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:52.145680 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:52.145691 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.147267 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.147279 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:52.149343 (+ 2064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:52.149358 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.150865 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.150872 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:52.151096 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:52.151157 (+ 61us) client_negotiation.cc:769] Sending connection context
0812 00:25:52.151302 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 00:25:52.152790 (+ 1488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16606,"mutex_wait_us":1289,"thread_start_us":15565,"threads_started":1}
I20260812 00:25:52.157205 7151 tablet_service.cc:1467] Processing CreateTablet for tablet ac58fa4b2d3e4c4f9b1025de2e6179ca (DEFAULT_TABLE table=test-table [id=1dfbdfe85a3a4e939d2c10165fa28841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:25:52.157375 7005 tablet_service.cc:1467] Processing CreateTablet for tablet ac58fa4b2d3e4c4f9b1025de2e6179ca (DEFAULT_TABLE table=test-table [id=1dfbdfe85a3a4e939d2c10165fa28841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:25:52.157375 7296 tablet_service.cc:1467] Processing CreateTablet for tablet ac58fa4b2d3e4c4f9b1025de2e6179ca (DEFAULT_TABLE table=test-table [id=1dfbdfe85a3a4e939d2c10165fa28841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:25:52.158846 7151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac58fa4b2d3e4c4f9b1025de2e6179ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:25:52.158941 7005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac58fa4b2d3e4c4f9b1025de2e6179ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:25:52.159353 7296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac58fa4b2d3e4c4f9b1025de2e6179ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:25:52.172161 7386 tablet_bootstrap.cc:492] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30: Bootstrap starting.
I20260812 00:25:52.174753 7387 tablet_bootstrap.cc:492] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580: Bootstrap starting.
I20260812 00:25:52.176470 7386 tablet_bootstrap.cc:654] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30: Neither blocks nor log segments found. Creating new log.
I20260812 00:25:52.176501 7388 tablet_bootstrap.cc:492] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a: Bootstrap starting.
I20260812 00:25:52.178824 7386 log.cc:824] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30: Log is configured to *not* fsync() on all Append() calls
I20260812 00:25:52.178901 7387 tablet_bootstrap.cc:654] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580: Neither blocks nor log segments found. Creating new log.
I20260812 00:25:52.180003 7388 tablet_bootstrap.cc:654] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a: Neither blocks nor log segments found. Creating new log.
I20260812 00:25:52.180184 7387 log.cc:824] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580: Log is configured to *not* fsync() on all Append() calls
I20260812 00:25:52.181306 7388 log.cc:824] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:25:52.182637 7386 tablet_bootstrap.cc:492] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30: No bootstrap required, opened a new log
I20260812 00:25:52.183032 7386 ts_tablet_manager.cc:1397] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260812 00:25:52.183699 7387 tablet_bootstrap.cc:492] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580: No bootstrap required, opened a new log
I20260812 00:25:52.183995 7387 ts_tablet_manager.cc:1397] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260812 00:25:52.184242 7388 tablet_bootstrap.cc:492] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a: No bootstrap required, opened a new log
I20260812 00:25:52.184504 7388 ts_tablet_manager.cc:1397] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 00:25:52.193190 7388 raft_consensus.cc:348] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbc60f2e76f740818dcef0250750300a" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33377 } } peers { permanent_uuid: "513485a1ffff41cb8ef7babd7a8f1f30" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36551 } } peers { permanent_uuid: "49790420257f4a3bb661d925e73bd580" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34291 } }
I20260812 00:25:52.193682 7388 raft_consensus.cc:374] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:25:52.193799 7388 raft_consensus.cc:729] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbc60f2e76f740818dcef0250750300a, State: Initialized, Role: FOLLOWER
I20260812 00:25:52.194519 7388 consensus_queue.cc:260] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbc60f2e76f740818dcef0250750300a" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33377 } } peers { permanent_uuid: "513485a1ffff41cb8ef7babd7a8f1f30" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36551 } } peers { permanent_uuid: "49790420257f4a3bb661d925e73bd580" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34291 } }
I20260812 00:25:52.194532 7386 raft_consensus.cc:348] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbc60f2e76f740818dcef0250750300a" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33377 } } peers { permanent_uuid: "513485a1ffff41cb8ef7babd7a8f1f30" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36551 } } peers { permanent_uuid: "49790420257f4a3bb661d925e73bd580" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34291 } }
I20260812 00:25:52.195078 7386 raft_consensus.cc:374] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:25:52.195211 7386 raft_consensus.cc:729] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 513485a1ffff41cb8ef7babd7a8f1f30, State: Initialized, Role: FOLLOWER
I20260812 00:25:52.195232 7387 raft_consensus.cc:348] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbc60f2e76f740818dcef0250750300a" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33377 } } peers { permanent_uuid: "513485a1ffff41cb8ef7babd7a8f1f30" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36551 } } peers { permanent_uuid: "49790420257f4a3bb661d925e73bd580" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34291 } }
I20260812 00:25:52.195683 7387 raft_consensus.cc:374] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:25:52.195806 7387 raft_consensus.cc:729] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49790420257f4a3bb661d925e73bd580, State: Initialized, Role: FOLLOWER
I20260812 00:25:52.195881 7386 consensus_queue.cc:260] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbc60f2e76f740818dcef0250750300a" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33377 } } peers { permanent_uuid: "513485a1ffff41cb8ef7babd7a8f1f30" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36551 } } peers { permanent_uuid: "49790420257f4a3bb661d925e73bd580" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34291 } }
I20260812 00:25:52.196401 7387 consensus_queue.cc:260] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbc60f2e76f740818dcef0250750300a" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33377 } } peers { permanent_uuid: "513485a1ffff41cb8ef7babd7a8f1f30" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36551 } } peers { permanent_uuid: "49790420257f4a3bb661d925e73bd580" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34291 } }
I20260812 00:25:52.198246 7386 ts_tablet_manager.cc:1428] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30: Time spent starting tablet: real 0.015s user 0.014s sys 0.001s
I20260812 00:25:52.198894 7224 heartbeater.cc:503] Master 127.18.163.254:43857 was elected leader, sending a full tablet report...
I20260812 00:25:52.201717 7367 heartbeater.cc:503] Master 127.18.163.254:43857 was elected leader, sending a full tablet report...
I20260812 00:25:52.202455 7388 ts_tablet_manager.cc:1428] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a: Time spent starting tablet: real 0.018s user 0.015s sys 0.004s
I20260812 00:25:52.204188 7387 ts_tablet_manager.cc:1428] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580: Time spent starting tablet: real 0.020s user 0.012s sys 0.009s
I20260812 00:25:52.269348 7394 raft_consensus.cc:482] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:25:52.269830 7394 raft_consensus.cc:504] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbc60f2e76f740818dcef0250750300a" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33377 } } peers { permanent_uuid: "513485a1ffff41cb8ef7babd7a8f1f30" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36551 } } peers { permanent_uuid: "49790420257f4a3bb661d925e73bd580" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34291 } }
I20260812 00:25:52.271862 7394 leader_election.cc:288] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbc60f2e76f740818dcef0250750300a (127.18.163.195:33377), 49790420257f4a3bb661d925e73bd580 (127.18.163.193:34291)
I20260812 00:25:52.280264 7385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:52.272429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:44665 (local address 127.18.163.193:34291)
0812 00:25:52.272801 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:52.272811 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:52.274185 (+ 1374us) server_negotiation.cc:407] Connection header received
0812 00:25:52.274470 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:52.274474 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:52.274565 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:52.274677 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:52.275397 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.276368 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.278338 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.279157 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.279373 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:52.279453 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:52.279849 (+ 396us) server_negotiation.cc:299] Negotiation successful
0812 00:25:52.280000 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167}
I20260812 00:25:52.280256 7382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:52.272506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:38805 (local address 127.18.163.195:33377)
0812 00:25:52.273017 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:52.273026 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:52.273846 (+ 820us) server_negotiation.cc:407] Connection header received
0812 00:25:52.274081 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:52.274111 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:52.274201 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:52.274283 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:52.274992 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.275987 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.278232 (+ 2245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.279100 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.279279 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:52.279363 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:52.279816 (+ 453us) server_negotiation.cc:299] Negotiation successful
0812 00:25:52.279967 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342}
I20260812 00:25:52.280342 7396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:52.272511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:34291 (local address 127.18.163.194:44665)
0812 00:25:52.274061 (+ 1550us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:52.274090 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:52.274233 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:52.274702 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:52.274707 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:52.274748 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:52.275204 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:52.275217 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.276530 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.276534 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:52.278082 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:52.278127 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.279405 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.279413 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:52.279607 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:52.279662 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 00:25:52.279785 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 00:25:52.279959 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1397,"mutex_wait_us":73,"thread_start_us":732,"threads_started":1}
W20260812 00:25:52.280561 7081 tablet.cc:2369] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:25:52.281208 7398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:52.272364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:33377 (local address 127.18.163.194:38805)
0812 00:25:52.273692 (+ 1328us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:52.273722 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:52.273918 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:52.274327 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:52.274335 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:52.274363 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:52.274828 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:52.274838 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.276140 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.276146 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:52.277953 (+ 1807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:52.277974 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.279338 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.279346 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:52.279611 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:52.279666 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 00:25:52.279743 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:25:52.279941 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1097,"mutex_wait_us":56,"thread_start_us":1315,"threads_started":1}
I20260812 00:25:52.281658 7027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac58fa4b2d3e4c4f9b1025de2e6179ca" candidate_uuid: "513485a1ffff41cb8ef7babd7a8f1f30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49790420257f4a3bb661d925e73bd580" is_pre_election: true
I20260812 00:25:52.282311 7027 raft_consensus.cc:2454] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 513485a1ffff41cb8ef7babd7a8f1f30 in term 0.
I20260812 00:25:52.282410 7320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac58fa4b2d3e4c4f9b1025de2e6179ca" candidate_uuid: "513485a1ffff41cb8ef7babd7a8f1f30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbc60f2e76f740818dcef0250750300a" is_pre_election: true
I20260812 00:25:52.282954 7320 raft_consensus.cc:2454] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 513485a1ffff41cb8ef7babd7a8f1f30 in term 0.
I20260812 00:25:52.283108 7102 leader_election.cc:302] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49790420257f4a3bb661d925e73bd580, 513485a1ffff41cb8ef7babd7a8f1f30; no voters:
I20260812 00:25:52.283607 7394 raft_consensus.cc:2781] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:25:52.283766 7394 raft_consensus.cc:482] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:25:52.283895 7394 raft_consensus.cc:3037] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:25:52.286420 7394 raft_consensus.cc:504] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbc60f2e76f740818dcef0250750300a" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33377 } } peers { permanent_uuid: "513485a1ffff41cb8ef7babd7a8f1f30" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36551 } } peers { permanent_uuid: "49790420257f4a3bb661d925e73bd580" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34291 } }
I20260812 00:25:52.287106 7394 leader_election.cc:288] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [CANDIDATE]: Term 1 election: Requested vote from peers bbc60f2e76f740818dcef0250750300a (127.18.163.195:33377), 49790420257f4a3bb661d925e73bd580 (127.18.163.193:34291)
I20260812 00:25:52.287748 7320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac58fa4b2d3e4c4f9b1025de2e6179ca" candidate_uuid: "513485a1ffff41cb8ef7babd7a8f1f30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbc60f2e76f740818dcef0250750300a"
I20260812 00:25:52.287747 7027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac58fa4b2d3e4c4f9b1025de2e6179ca" candidate_uuid: "513485a1ffff41cb8ef7babd7a8f1f30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49790420257f4a3bb661d925e73bd580"
I20260812 00:25:52.287990 7320 raft_consensus.cc:3037] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:25:52.288002 7027 raft_consensus.cc:3037] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:25:52.290609 7320 raft_consensus.cc:2454] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 513485a1ffff41cb8ef7babd7a8f1f30 in term 1.
I20260812 00:25:52.290731 7027 raft_consensus.cc:2454] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 513485a1ffff41cb8ef7babd7a8f1f30 in term 1.
I20260812 00:25:52.291226 7101 leader_election.cc:302] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 513485a1ffff41cb8ef7babd7a8f1f30, bbc60f2e76f740818dcef0250750300a; no voters:
I20260812 00:25:52.291602 7394 raft_consensus.cc:2781] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:25:52.292204 7394 raft_consensus.cc:686] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [term 1 LEADER]: Becoming Leader. State: Replica: 513485a1ffff41cb8ef7babd7a8f1f30, State: Running, Role: LEADER
I20260812 00:25:52.292716 7394 consensus_queue.cc:237] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbc60f2e76f740818dcef0250750300a" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33377 } } peers { permanent_uuid: "513485a1ffff41cb8ef7babd7a8f1f30" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36551 } } peers { permanent_uuid: "49790420257f4a3bb661d925e73bd580" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34291 } }
I20260812 00:25:52.298189 6864 catalog_manager.cc:5495] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 513485a1ffff41cb8ef7babd7a8f1f30 (127.18.163.194). New cstate: current_term: 1 leader_uuid: "513485a1ffff41cb8ef7babd7a8f1f30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbc60f2e76f740818dcef0250750300a" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "513485a1ffff41cb8ef7babd7a8f1f30" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 36551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49790420257f4a3bb661d925e73bd580" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34291 } health_report { overall_health: UNKNOWN } } }
W20260812 00:25:52.309031 7225 tablet.cc:2369] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:25:52.316221 7384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:52.310347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43814 (local address 127.18.163.194:36551)
0812 00:25:52.310547 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:52.310555 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:52.310669 (+ 114us) server_negotiation.cc:407] Connection header received
0812 00:25:52.310947 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:52.310951 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:52.311049 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:52.311230 (+ 181us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:25:52.311639 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.312359 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.313874 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.314320 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.314472 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:52.315054 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:25:52.315658 (+ 604us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:25:52.315788 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:52.315914 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 00:25:52.315991 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260812 00:25:52.319927 7368 tablet.cc:2369] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:25:52.326105 7027 raft_consensus.cc:1261] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580 [term 1 FOLLOWER]: Refusing update from remote peer 513485a1ffff41cb8ef7babd7a8f1f30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:25:52.326105 7320 raft_consensus.cc:1261] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a [term 1 FOLLOWER]: Refusing update from remote peer 513485a1ffff41cb8ef7babd7a8f1f30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:25:52.327291 7399 consensus_queue.cc:1035] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbc60f2e76f740818dcef0250750300a" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:25:52.327733 7394 consensus_queue.cc:1035] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49790420257f4a3bb661d925e73bd580" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:25:52.363016 6865 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:25:52.363334 6865 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:25:52.367660 6865 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 25e053526c684270a56f45cd5bfed935: Sending DeleteTablet for 3 replicas of tablet ac58fa4b2d3e4c4f9b1025de2e6179ca
I20260812 00:25:52.369608 7151 tablet_service.cc:1514] Processing DeleteTablet for tablet ac58fa4b2d3e4c4f9b1025de2e6179ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:25:52 UTC) from {username='slave'} at 127.0.0.1:43812
I20260812 00:25:52.369565 7296 tablet_service.cc:1514] Processing DeleteTablet for tablet ac58fa4b2d3e4c4f9b1025de2e6179ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:25:52 UTC) from {username='slave'} at 127.0.0.1:57614
I20260812 00:25:52.371052 7415 tablet_replica.cc:330] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30: stopping tablet replica
I20260812 00:25:52.371285 7005 tablet_service.cc:1514] Processing DeleteTablet for tablet ac58fa4b2d3e4c4f9b1025de2e6179ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:25:52 UTC) from {username='slave'} at 127.0.0.1:37736
I20260812 00:25:52.371585 7415 raft_consensus.cc:2229] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:25:52.372465 7415 raft_consensus.cc:2258] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:25:52.373564 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 6932
I20260812 00:25:52.375241 7415 ts_tablet_manager.cc:1905] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:25:52.378304 7417 tablet_replica.cc:330] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580: stopping tablet replica
I20260812 00:25:52.378976 7417 raft_consensus.cc:2229] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:25:52.379626 7417 raft_consensus.cc:2258] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:25:52.381942 7416 tablet_replica.cc:330] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a: stopping tablet replica
I20260812 00:25:52.382480 7416 raft_consensus.cc:2229] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:25:52.383106 7416 raft_consensus.cc:2258] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:25:52.385684 7415 ts_tablet_manager.cc:1918] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:25:52.385998 7415 log.cc:1196] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/ac58fa4b2d3e4c4f9b1025de2e6179ca
I20260812 00:25:52.386787 7415 ts_tablet_manager.cc:1939] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 513485a1ffff41cb8ef7babd7a8f1f30: Deleting consensus metadata
I20260812 00:25:52.387637 7416 ts_tablet_manager.cc:1905] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:25:52.387830 7417 ts_tablet_manager.cc:1905] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:25:52.389221 6848 catalog_manager.cc:4841] TS 513485a1ffff41cb8ef7babd7a8f1f30 (127.18.163.194:36551): tablet ac58fa4b2d3e4c4f9b1025de2e6179ca (table test-table [id=1dfbdfe85a3a4e939d2c10165fa28841]) successfully deleted
I20260812 00:25:52.395699 7417 ts_tablet_manager.cc:1918] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:25:52.395923 7417 log.cc:1196] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/ac58fa4b2d3e4c4f9b1025de2e6179ca
I20260812 00:25:52.396538 7417 ts_tablet_manager.cc:1939] T ac58fa4b2d3e4c4f9b1025de2e6179ca P 49790420257f4a3bb661d925e73bd580: Deleting consensus metadata
I20260812 00:25:52.397725 7416 ts_tablet_manager.cc:1918] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:25:52.397934 7416 log.cc:1196] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/ac58fa4b2d3e4c4f9b1025de2e6179ca
I20260812 00:25:52.398515 7416 ts_tablet_manager.cc:1939] T ac58fa4b2d3e4c4f9b1025de2e6179ca P bbc60f2e76f740818dcef0250750300a: Deleting consensus metadata
I20260812 00:25:52.398715 6851 catalog_manager.cc:4841] TS 49790420257f4a3bb661d925e73bd580 (127.18.163.193:34291): tablet ac58fa4b2d3e4c4f9b1025de2e6179ca (table test-table [id=1dfbdfe85a3a4e939d2c10165fa28841]) successfully deleted
I20260812 00:25:52.400542 6849 catalog_manager.cc:4841] TS bbc60f2e76f740818dcef0250750300a (127.18.163.195:33377): tablet ac58fa4b2d3e4c4f9b1025de2e6179ca (table test-table [id=1dfbdfe85a3a4e939d2c10165fa28841]) successfully deleted
I20260812 00:25:52.402842 7385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:52.374967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37740 (local address 127.18.163.193:34291)
0812 00:25:52.375170 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:52.375177 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:52.390849 (+ 15672us) server_negotiation.cc:407] Connection header received
0812 00:25:52.391066 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:52.391072 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:52.391201 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:52.391317 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:52.392044 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.393327 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.398797 (+ 5470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.399363 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.399451 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:52.401224 (+ 1773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:52.401234 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:52.401249 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:25:52.401954 (+ 705us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:52.402014 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:25:52.402036 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:52.402171 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:52.402347 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 00:25:52.402478 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:25:52.403586 7074 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:52.500291 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 6932
I20260812 00:25:52.531491 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 7085
I20260812 00:25:52.539346 7384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:52.532406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43828 (local address 127.18.163.194:36551)
0812 00:25:52.532656 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:52.532662 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:52.532682 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:25:52.532859 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:52.532864 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:52.532962 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:52.533088 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:52.533539 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.534432 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.535854 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.536325 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.536469 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:52.537779 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:52.537791 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:52.537806 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:25:52.538485 (+ 679us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:52.538539 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:25:52.538562 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:52.538693 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:52.538851 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 00:25:52.538971 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260812 00:25:52.540196 7218 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:52.661816 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 7085
I20260812 00:25:52.685148 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 7228
I20260812 00:25:52.692821 7382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:52.685986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57626 (local address 127.18.163.195:33377)
0812 00:25:52.686198 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:52.686205 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:52.686318 (+ 113us) server_negotiation.cc:407] Connection header received
0812 00:25:52.686535 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:52.686541 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:52.686652 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:52.686768 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:52.687232 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.687993 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.689409 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:52.689921 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:52.690062 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:52.691328 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:52.691337 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:52.691351 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:25:52.691987 (+ 636us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:52.692038 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:25:52.692057 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:52.692197 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:52.692342 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 00:25:52.692474 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:25:52.693513 7362 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:52.785962 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 7228
I20260812 00:25:52.808518 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 6829
I20260812 00:25:52.809796 6898 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:52.924405 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 6829
2026-08-12T00:25:52Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3144 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:25:53 dist-test-slave-njxd krb5kdc[7426](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:25:53 dist-test-slave-njxd krb5kdc[7426](info): set up 2 sockets
Aug 12 00:25:53 dist-test-slave-njxd krb5kdc[7426](info): commencing operation
krb5kdc: starting...
W20260812 00:25:54.162014 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.187s user 0.003s sys 0.060s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:25:54 dist-test-slave-njxd krb5kdc[7426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:25:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:25:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:25:54.537690 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44643
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:32923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:44643
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:25:54.911532 7442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:54.911966 7442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:54.912144 7442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:54.919831 7442 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:25:54.920015 7442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:54.920147 7442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:54.920254 7442 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:25:54.920341 7442 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:25:54.931330 7442 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:32923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:44643
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44643
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:54.932884 7442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:54.934482 7442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:54.947742 7447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:54.947760 7450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:54.947685 7448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:54.948786 7442 server_base.cc:1034] running on GCE node
I20260812 00:25:54.949774 7442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:54.951478 7442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:54.952749 7442 hybrid_clock.cc:648] HybridClock initialized: now 1786494354952698 us; error 47 us; skew 500 ppm
I20260812 00:25:54.953158 7442 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:25:54 dist-test-slave-njxd krb5kdc[7426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494354, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:25:54.956626 7442 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:25:54.958295 7442 webserver.cc:460] Webserver started at http://127.18.163.254:45781/ using document root <none> and password file <none>
I20260812 00:25:54.959029 7442 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:54.959143 7442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:54.959420 7442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:25:54.962738 7442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "5fbab54363f5471c923df935ebcc2b38"
format_stamp: "Formatted at 2026-08-12 00:25:54 on dist-test-slave-njxd"
server_key: "a3045c1faf54f31a4dba10558a06f0a0"
server_key_iv: "96fe14a4395ba83d5da409a4e26fb742"
server_key_version: "encryptionkey@0"
I20260812 00:25:54.963518 7442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "5fbab54363f5471c923df935ebcc2b38"
format_stamp: "Formatted at 2026-08-12 00:25:54 on dist-test-slave-njxd"
server_key: "a3045c1faf54f31a4dba10558a06f0a0"
server_key_iv: "96fe14a4395ba83d5da409a4e26fb742"
server_key_version: "encryptionkey@0"
I20260812 00:25:54.969482 7442 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 00:25:54.973448 7457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:54.975214 7442 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 00:25:54.975456 7442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "5fbab54363f5471c923df935ebcc2b38"
format_stamp: "Formatted at 2026-08-12 00:25:54 on dist-test-slave-njxd"
server_key: "a3045c1faf54f31a4dba10558a06f0a0"
server_key_iv: "96fe14a4395ba83d5da409a4e26fb742"
server_key_version: "encryptionkey@0"
I20260812 00:25:54.975708 7442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:55.002285 7442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:55.006937 7442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:55.007270 7442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:55.027467 7442 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:44643
I20260812 00:25:55.027490 7515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:44643 every 8 connection(s)
I20260812 00:25:55.028990 7442 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:25:55.033198 7516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:25:55.036638 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 7442
I20260812 00:25:55.036865 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:25:55.037452 19087 external_mini_cluster.cc:1428] Setting key 892e7635857ed93067903a7fa02cda8a
I20260812 00:25:55.047333 7516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38: Bootstrap starting.
I20260812 00:25:55.051864 7516 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38: Neither blocks nor log segments found. Creating new log.
I20260812 00:25:55.053444 7516 log.cc:824] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38: Log is configured to *not* fsync() on all Append() calls
Aug 12 00:25:55 dist-test-slave-njxd krb5kdc[7426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:25:55.057543 7516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38: No bootstrap required, opened a new log
I20260812 00:25:55.065982 7519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:55.039735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48968 (local address 127.18.163.254:44643)
0812 00:25:55.040668 (+ 933us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:55.040681 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:55.040735 (+ 54us) server_negotiation.cc:407] Connection header received
0812 00:25:55.042582 (+ 1847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:55.042607 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:55.043073 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:55.043440 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:55.045625 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:55.047052 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:55.049160 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:55.050014 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:55.050170 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:55.056019 (+ 5849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:55.056035 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:55.056058 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:55.056110 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:55.060494 (+ 4384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:55.061405 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:55.061415 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:55.061431 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:55.061719 (+ 288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:55.062160 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:55.062165 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:55.062170 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:55.062966 (+ 796us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:55.063331 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:55.063709 (+ 378us) server_negotiation.cc:299] Negotiation successful
0812 00:25:55.064284 (+ 575us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":472,"threads_started":1}
I20260812 00:25:55.068969 7516 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fbab54363f5471c923df935ebcc2b38" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44643 } }
I20260812 00:25:55.069550 7516 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:25:55.069798 7516 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fbab54363f5471c923df935ebcc2b38, State: Initialized, Role: FOLLOWER
I20260812 00:25:55.070468 7516 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fbab54363f5471c923df935ebcc2b38" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44643 } }
I20260812 00:25:55.070763 7516 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:25:55.070933 7516 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:25:55.071118 7516 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:25:55.075193 7516 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fbab54363f5471c923df935ebcc2b38" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44643 } }
I20260812 00:25:55.075969 7516 leader_election.cc:302] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5fbab54363f5471c923df935ebcc2b38; no voters:
I20260812 00:25:55.076800 7516 leader_election.cc:288] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:25:55.076931 7521 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:25:55.079447 7521 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [term 1 LEADER]: Becoming Leader. State: Replica: 5fbab54363f5471c923df935ebcc2b38, State: Running, Role: LEADER
I20260812 00:25:55.079694 7516 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:25:55.080278 7521 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fbab54363f5471c923df935ebcc2b38" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44643 } }
I20260812 00:25:55.084189 7523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5fbab54363f5471c923df935ebcc2b38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fbab54363f5471c923df935ebcc2b38" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44643 } } }
I20260812 00:25:55.084703 7523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [sys.catalog]: This master's current role is: LEADER
I20260812 00:25:55.085305 7524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5fbab54363f5471c923df935ebcc2b38. Latest consensus state: current_term: 1 leader_uuid: "5fbab54363f5471c923df935ebcc2b38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fbab54363f5471c923df935ebcc2b38" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44643 } } }
I20260812 00:25:55.085731 7532 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:25:55.085740 7524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38 [sys.catalog]: This master's current role is: LEADER
I20260812 00:25:55.091998 7532 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:25:55.101675 7532 catalog_manager.cc:1347] Generated new cluster ID: b813bf8e51d242f89ab7b6a2ee82219b
I20260812 00:25:55.101850 7532 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:25:55.114594 7532 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:25:55.116371 7532 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:25:55.126204 7532 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38: Generated new TSK 0
I20260812 00:25:55.127481 7532 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:25:55.222162 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44643
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:32923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:25:55.595467 7544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:55.595785 7544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:55.595960 7544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:55.603680 7544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:55.603847 7544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:55.604043 7544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:25:55.614717 7544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:32923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44643
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:55.616209 7544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:55.617744 7544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:55.632359 7550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:55.632396 7552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:55.632552 7549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:55.633373 7544 server_base.cc:1034] running on GCE node
I20260812 00:25:55.634168 7544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:55.635269 7544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:55.636523 7544 hybrid_clock.cc:648] HybridClock initialized: now 1786494355636482 us; error 45 us; skew 500 ppm
I20260812 00:25:55.636883 7544 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:25:55 dist-test-slave-njxd krb5kdc[7426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494355, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:25:55.640458 7544 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:25:55.642256 7544 webserver.cc:460] Webserver started at http://127.18.163.193:36629/ using document root <none> and password file <none>
I20260812 00:25:55.642999 7544 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:55.643113 7544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:55.643433 7544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:25:55.646827 7544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "0b9df842672749bba91d63366ed1b430"
format_stamp: "Formatted at 2026-08-12 00:25:55 on dist-test-slave-njxd"
server_key: "a0df4bd348584f8d850d4e245ce37710"
server_key_iv: "3aa7442317c4f9e32b4eb192ca9dde4f"
server_key_version: "encryptionkey@0"
I20260812 00:25:55.647678 7544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "0b9df842672749bba91d63366ed1b430"
format_stamp: "Formatted at 2026-08-12 00:25:55 on dist-test-slave-njxd"
server_key: "a0df4bd348584f8d850d4e245ce37710"
server_key_iv: "3aa7442317c4f9e32b4eb192ca9dde4f"
server_key_version: "encryptionkey@0"
I20260812 00:25:55.653879 7544 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260812 00:25:55.658049 7559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:55.660030 7544 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260812 00:25:55.660233 7544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "0b9df842672749bba91d63366ed1b430"
format_stamp: "Formatted at 2026-08-12 00:25:55 on dist-test-slave-njxd"
server_key: "a0df4bd348584f8d850d4e245ce37710"
server_key_iv: "3aa7442317c4f9e32b4eb192ca9dde4f"
server_key_version: "encryptionkey@0"
I20260812 00:25:55.660528 7544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:55.676797 7544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:55.681816 7544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:55.682160 7544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:55.683271 7544 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:25:55.684911 7544 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:25:55.684991 7544 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:55.685145 7544 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:25:55.685228 7544 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:55.722227 7544 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:34191
I20260812 00:25:55.722275 7684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:34191 every 8 connection(s)
I20260812 00:25:55.723681 7544 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:25:55.730540 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 7544
I20260812 00:25:55.730770 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:25:55.731241 19087 external_mini_cluster.cc:1428] Setting key 8af561f9627265a7af27640e76c95d3a
Aug 12 00:25:55 dist-test-slave-njxd krb5kdc[7426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494355, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:25:55.748775 7687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:55.726545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:53423 (local address 127.18.163.254:44643)
0812 00:25:55.727078 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:55.727084 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:55.728270 (+ 1186us) server_negotiation.cc:407] Connection header received
0812 00:25:55.730484 (+ 2214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:55.730489 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:55.730571 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:55.730736 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:55.732759 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:55.733703 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:55.736508 (+ 2805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:55.736941 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:55.737046 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:55.742096 (+ 5050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:55.742103 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:55.742107 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:55.742153 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:55.744907 (+ 2754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:55.746037 (+ 1130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:55.746041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:55.746044 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:55.746193 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:55.746765 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:55.746768 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:55.746770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:55.747047 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:55.747179 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:55.748279 (+ 1100us) server_negotiation.cc:299] Negotiation successful
0812 00:25:55.748493 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":242,"threads_started":1}
I20260812 00:25:55.750460 7688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:55.727271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44643 (local address 127.18.163.193:53423)
0812 00:25:55.728087 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:55.728129 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:55.730072 (+ 1943us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:55.731038 (+ 966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:55.731048 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:55.731743 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:25:55.732520 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:55.732552 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:55.733906 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:55.733913 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:55.736296 (+ 2383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:55.736321 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:55.737207 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:55.737217 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:55.737616 (+ 399us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:55.738460 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:25:55.738502 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:25:55.741798 (+ 3296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:25:55.745101 (+ 3303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:55.745114 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:55.745138 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:55.745897 (+ 759us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:55.746317 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:55.746324 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:55.746330 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:55.746643 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:55.747184 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:25:55.747195 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:25:55.747755 (+ 560us) client_negotiation.cc:769] Sending connection context
0812 00:25:55.748116 (+ 361us) client_negotiation.cc:240] Negotiation successful
0812 00:25:55.748783 (+ 667us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":305,"threads_started":1}
I20260812 00:25:55.752255 7685 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44643
I20260812 00:25:55.752633 7685 heartbeater.cc:464] Registering TS with master...
I20260812 00:25:55.753643 7685 heartbeater.cc:511] Master 127.18.163.254:44643 requested a full tablet report, sending...
I20260812 00:25:55.756106 7477 ts_manager.cc:194] Registered new tserver with Master: 0b9df842672749bba91d63366ed1b430 (127.18.163.193:34191)
I20260812 00:25:55.757777 7477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:53423
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:25:55.813284 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44643
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:32923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:25:56.189354 7691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:56.189787 7691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:56.189994 7691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:56.197745 7691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:56.197875 7691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:56.198079 7691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:25:56.208519 7691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:32923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44643
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:56.210035 7691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:56.211458 7691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:56.225929 7698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:56.226145 7700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:56.226521 7697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:56.227240 7691 server_base.cc:1034] running on GCE node
I20260812 00:25:56.227954 7691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:56.229123 7691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:56.230422 7691 hybrid_clock.cc:648] HybridClock initialized: now 1786494356230347 us; error 59 us; skew 500 ppm
I20260812 00:25:56.230835 7691 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:25:56 dist-test-slave-njxd krb5kdc[7426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494356, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:25:56.234375 7691 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:25:56.236040 7691 webserver.cc:460] Webserver started at http://127.18.163.194:36347/ using document root <none> and password file <none>
I20260812 00:25:56.236824 7691 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:56.236982 7691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:56.237347 7691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:25:56.240662 7691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "fd08063cc2db46cca1da6f9b0445cd25"
format_stamp: "Formatted at 2026-08-12 00:25:56 on dist-test-slave-njxd"
server_key: "feaafbc48627a40ec09fc9d3bf0118f3"
server_key_iv: "3b7542001620a8e487538a0b4a76cb4e"
server_key_version: "encryptionkey@0"
I20260812 00:25:56.241493 7691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "fd08063cc2db46cca1da6f9b0445cd25"
format_stamp: "Formatted at 2026-08-12 00:25:56 on dist-test-slave-njxd"
server_key: "feaafbc48627a40ec09fc9d3bf0118f3"
server_key_iv: "3b7542001620a8e487538a0b4a76cb4e"
server_key_version: "encryptionkey@0"
I20260812 00:25:56.247278 7691 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 00:25:56.251542 7708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:56.253137 7691 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:25:56.253355 7691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "fd08063cc2db46cca1da6f9b0445cd25"
format_stamp: "Formatted at 2026-08-12 00:25:56 on dist-test-slave-njxd"
server_key: "feaafbc48627a40ec09fc9d3bf0118f3"
server_key_iv: "3b7542001620a8e487538a0b4a76cb4e"
server_key_version: "encryptionkey@0"
I20260812 00:25:56.253623 7691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:56.280790 7691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:56.285667 7691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:56.286012 7691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:56.287205 7691 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:25:56.288842 7691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:25:56.288961 7691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:56.289117 7691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:25:56.289193 7691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:56.326193 7691 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:39681
I20260812 00:25:56.326262 7836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:39681 every 8 connection(s)
I20260812 00:25:56.327692 7691 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:25:56.331537 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 7691
I20260812 00:25:56.331771 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:25:56.332422 19087 external_mini_cluster.cc:1428] Setting key d480d1eeac0d8e24eab5e3f9952b32d9
Aug 12 00:25:56 dist-test-slave-njxd krb5kdc[7426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494356, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:25:56.353412 7839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:56.330803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:52463 (local address 127.18.163.254:44643)
0812 00:25:56.331401 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:56.331408 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:56.332603 (+ 1195us) server_negotiation.cc:407] Connection header received
0812 00:25:56.335214 (+ 2611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:56.335219 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:56.335289 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:56.335383 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:56.337866 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:56.338639 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:56.341327 (+ 2688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:56.341881 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:56.341994 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:56.346811 (+ 4817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:56.346816 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:56.346819 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:56.346859 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:56.349853 (+ 2994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:56.350810 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:56.350815 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:56.350817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:56.350950 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:56.351488 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:56.351492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:56.351494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:56.351802 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:56.351989 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:56.352772 (+ 783us) server_negotiation.cc:299] Negotiation successful
0812 00:25:56.353026 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":273,"threads_started":1}
I20260812 00:25:56.354568 7840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:56.331422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44643 (local address 127.18.163.194:52463)
0812 00:25:56.332389 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:56.332455 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:56.334836 (+ 2381us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:56.335719 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:56.335734 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:56.336642 (+ 908us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:25:56.337632 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:56.337667 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:56.338852 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:56.338860 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:56.341117 (+ 2257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:56.341139 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:56.342171 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:56.342181 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:56.342564 (+ 383us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:56.343419 (+ 855us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:25:56.343458 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:25:56.346496 (+ 3038us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:25:56.350058 (+ 3562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:56.350070 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:56.350092 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:56.350629 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:56.351084 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:56.351089 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:56.351093 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:56.351334 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:56.351962 (+ 628us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:25:56.351971 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:25:56.352374 (+ 403us) client_negotiation.cc:769] Sending connection context
0812 00:25:56.352664 (+ 290us) client_negotiation.cc:240] Negotiation successful
0812 00:25:56.353287 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":372,"threads_started":1}
I20260812 00:25:56.356295 7837 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44643
I20260812 00:25:56.356683 7837 heartbeater.cc:464] Registering TS with master...
I20260812 00:25:56.357749 7837 heartbeater.cc:511] Master 127.18.163.254:44643 requested a full tablet report, sending...
I20260812 00:25:56.359556 7477 ts_manager.cc:194] Registered new tserver with Master: fd08063cc2db46cca1da6f9b0445cd25 (127.18.163.194:39681)
I20260812 00:25:56.360934 7477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:52463
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
I20260812 00:25:56.416617 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44643
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:32923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:25:56.762018 7685 heartbeater.cc:503] Master 127.18.163.254:44643 was elected leader, sending a full tablet report...
W20260812 00:25:56.792330 7844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:56.792630 7844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:56.792811 7844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:56.800329 7844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:56.800474 7844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:56.800705 7844 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:25:56.810967 7844 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:32923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44643
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:56.812431 7844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:56.813966 7844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:56.828203 7850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:56.828158 7851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:56.828176 7853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:56.829819 7844 server_base.cc:1034] running on GCE node
I20260812 00:25:56.830565 7844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:56.831660 7844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:56.832937 7844 hybrid_clock.cc:648] HybridClock initialized: now 1786494356832885 us; error 65 us; skew 500 ppm
I20260812 00:25:56.833307 7844 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:25:56 dist-test-slave-njxd krb5kdc[7426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494356, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:25:56.836922 7844 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:25:56.838608 7844 webserver.cc:460] Webserver started at http://127.18.163.195:44057/ using document root <none> and password file <none>
I20260812 00:25:56.839402 7844 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:56.839567 7844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:56.839926 7844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:25:56.843223 7844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "74ec04933d824c4f925304243b8f7b61"
format_stamp: "Formatted at 2026-08-12 00:25:56 on dist-test-slave-njxd"
server_key: "a54676ef65351e963d519878c7d77070"
server_key_iv: "e09c467f03906ce9e16e95ac701671a7"
server_key_version: "encryptionkey@0"
I20260812 00:25:56.844107 7844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "74ec04933d824c4f925304243b8f7b61"
format_stamp: "Formatted at 2026-08-12 00:25:56 on dist-test-slave-njxd"
server_key: "a54676ef65351e963d519878c7d77070"
server_key_iv: "e09c467f03906ce9e16e95ac701671a7"
server_key_version: "encryptionkey@0"
I20260812 00:25:56.849993 7844 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260812 00:25:56.853995 7860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:56.855568 7844 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260812 00:25:56.855794 7844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "74ec04933d824c4f925304243b8f7b61"
format_stamp: "Formatted at 2026-08-12 00:25:56 on dist-test-slave-njxd"
server_key: "a54676ef65351e963d519878c7d77070"
server_key_iv: "e09c467f03906ce9e16e95ac701671a7"
server_key_version: "encryptionkey@0"
I20260812 00:25:56.856006 7844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:56.891496 7844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:56.896325 7844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:56.896613 7844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:56.897727 7844 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:25:56.899195 7844 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:25:56.899278 7844 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:56.899369 7844 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:25:56.899415 7844 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:56.936041 7844 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:33133
I20260812 00:25:56.936141 7989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:33133 every 8 connection(s)
I20260812 00:25:56.937475 7844 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:25:56.945734 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 7844
I20260812 00:25:56.945959 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:25:56.946444 19087 external_mini_cluster.cc:1428] Setting key 8f6c5cc54f1f34bc177bb252edfd5a5a
Aug 12 00:25:56 dist-test-slave-njxd krb5kdc[7426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494356, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:25:56.959712 7993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:56.940351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:55563 (local address 127.18.163.254:44643)
0812 00:25:56.940831 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:56.940836 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:56.941978 (+ 1142us) server_negotiation.cc:407] Connection header received
0812 00:25:56.943937 (+ 1959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:56.943944 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:56.944063 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:56.944194 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:56.945958 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:56.946870 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:56.948928 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:56.949502 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:56.949673 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:56.953652 (+ 3979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:56.953658 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:56.953662 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:56.953704 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:56.956257 (+ 2553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:56.957156 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:56.957160 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:56.957163 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:56.957303 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:56.957854 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:56.957859 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:56.957868 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:56.958168 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:56.958306 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:56.959172 (+ 866us) server_negotiation.cc:299] Negotiation successful
0812 00:25:56.959376 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":227,"threads_started":1}
I20260812 00:25:56.961063 7994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:56.941005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44643 (local address 127.18.163.195:55563)
0812 00:25:56.941803 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:56.941851 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:56.943638 (+ 1787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:56.944452 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:56.944461 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:56.945029 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:25:56.945714 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:56.945737 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:56.947044 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:56.947051 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:56.948776 (+ 1725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:56.948790 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:56.949802 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:56.949810 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:56.950058 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:56.950801 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:25:56.950827 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:25:56.953308 (+ 2481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:25:56.956436 (+ 3128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:56.956444 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:56.956461 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:56.957022 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:56.957437 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:25:56.957440 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:25:56.957443 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:25:56.957726 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:25:56.958352 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:25:56.958364 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:25:56.958784 (+ 420us) client_negotiation.cc:769] Sending connection context
0812 00:25:56.959037 (+ 253us) client_negotiation.cc:240] Negotiation successful
0812 00:25:56.959561 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":301,"threads_started":1}
I20260812 00:25:56.962658 7990 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44643
I20260812 00:25:56.962997 7990 heartbeater.cc:464] Registering TS with master...
I20260812 00:25:56.963797 7990 heartbeater.cc:511] Master 127.18.163.254:44643 requested a full tablet report, sending...
I20260812 00:25:56.965384 7477 ts_manager.cc:194] Registered new tserver with Master: 74ec04933d824c4f925304243b8f7b61 (127.18.163.195:33133)
I20260812 00:25:56.966295 7477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:55563
I20260812 00:25:56.975168 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:25:57.002969 7993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:56.979692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48970 (local address 127.18.163.254:44643)
0812 00:25:56.979909 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:56.979917 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:56.980457 (+ 540us) server_negotiation.cc:407] Connection header received
0812 00:25:56.980616 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:56.980620 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:56.980693 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:56.980787 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:56.982531 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:56.983307 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:56.984918 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:56.985355 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:56.985535 (+ 180us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:56.993891 (+ 8356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:56.993899 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:56.993904 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:56.993959 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:57.000035 (+ 6076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:57.000980 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:57.000984 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:57.000986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:57.001124 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:57.001654 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:57.001658 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:57.001662 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:57.001993 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:57.002208 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:57.002565 (+ 357us) server_negotiation.cc:299] Negotiation successful
0812 00:25:57.002725 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 00:25:57.007282 7477 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48970:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:25:57.014616 7477 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:25:57.058533 8006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.028905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46714 (local address 127.18.163.195:33133)
0812 00:25:57.044721 (+ 15816us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:57.044735 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:57.044787 (+ 52us) server_negotiation.cc:407] Connection header received
0812 00:25:57.044929 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:57.044943 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:57.045348 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:57.045690 (+ 342us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:57.047238 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.049558 (+ 2320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.053611 (+ 4053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.055752 (+ 2141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.056032 (+ 280us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:57.056307 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:57.057711 (+ 1404us) server_negotiation.cc:299] Negotiation successful
0812 00:25:57.057978 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15567,"thread_start_us":15082,"threads_started":1}
I20260812 00:25:57.059223 8008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.028063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:33133 (local address 127.0.0.1:46714)
0812 00:25:57.040556 (+ 12493us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:57.040626 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:57.040973 (+ 347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:57.046170 (+ 5197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:57.046183 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:57.046236 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:57.046896 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:57.046916 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.049842 (+ 2926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.049851 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:57.053364 (+ 3513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:57.053387 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.056561 (+ 3174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.056572 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:57.056930 (+ 358us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:57.057018 (+ 88us) client_negotiation.cc:769] Sending connection context
0812 00:25:57.057233 (+ 215us) client_negotiation.cc:240] Negotiation successful
0812 00:25:57.057549 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12068,"thread_start_us":24912,"threads_started":1}
I20260812 00:25:57.070084 8009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.030847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34184 (local address 127.18.163.193:34191)
0812 00:25:57.052622 (+ 21775us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:57.052633 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:57.055435 (+ 2802us) server_negotiation.cc:407] Connection header received
0812 00:25:57.055594 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:57.055607 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:57.056003 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:57.056287 (+ 284us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:57.057633 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.061448 (+ 3815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.065454 (+ 4006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.067814 (+ 2360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.068070 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:57.068345 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:57.069389 (+ 1044us) server_negotiation.cc:299] Negotiation successful
0812 00:25:57.069654 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21562,"thread_start_us":21769,"threads_started":1}
I20260812 00:25:57.070631 8005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.029163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:34191 (local address 127.0.0.1:34184)
0812 00:25:57.053336 (+ 24173us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:57.055062 (+ 1726us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:57.055248 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:57.056672 (+ 1424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:57.056680 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:57.056720 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:57.057327 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:57.057343 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.061728 (+ 4385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.061737 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:57.065072 (+ 3335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:57.065102 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.068625 (+ 3523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.068634 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:57.068921 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:57.068979 (+ 58us) client_negotiation.cc:769] Sending connection context
0812 00:25:57.069102 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 00:25:57.069961 (+ 859us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23995,"mutex_wait_us":3,"thread_start_us":10739,"threads_started":1}
I20260812 00:25:57.076218 7915 tablet_service.cc:1467] Processing CreateTablet for tablet 713813e95ca045b98dfd7671eb4ddb24 (DEFAULT_TABLE table=test-table [id=11eed8abf48c4512bccb23c432b0e096]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:25:57.076217 7612 tablet_service.cc:1467] Processing CreateTablet for tablet 713813e95ca045b98dfd7671eb4ddb24 (DEFAULT_TABLE table=test-table [id=11eed8abf48c4512bccb23c432b0e096]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:25:57.077216 8011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.053870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58380 (local address 127.18.163.194:39681)
0812 00:25:57.066972 (+ 13102us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:57.066980 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:57.067007 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:25:57.067104 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:57.067110 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:57.067341 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:57.067584 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:57.067969 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.068980 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.071682 (+ 2702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.075114 (+ 3432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.075316 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:57.075496 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:57.076675 (+ 1179us) server_negotiation.cc:299] Negotiation successful
0812 00:25:57.076871 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12918,"thread_start_us":12573,"threads_started":1}
I20260812 00:25:57.076503 8008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.053829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:39681 (local address 127.0.0.1:58380)
0812 00:25:57.059530 (+ 5701us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:57.059558 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:57.059695 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:57.067576 (+ 7881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:57.067582 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:57.067613 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:57.067837 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:57.067851 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.069286 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.069296 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:57.071433 (+ 2137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:57.071454 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.075636 (+ 4182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.075642 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:57.075839 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:57.075876 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 00:25:57.075982 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 00:25:57.076150 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5572,"thread_start_us":16705,"threads_started":1}
I20260812 00:25:57.078182 7915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 713813e95ca045b98dfd7671eb4ddb24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:25:57.078691 7612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 713813e95ca045b98dfd7671eb4ddb24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:25:57.081916 7763 tablet_service.cc:1467] Processing CreateTablet for tablet 713813e95ca045b98dfd7671eb4ddb24 (DEFAULT_TABLE table=test-table [id=11eed8abf48c4512bccb23c432b0e096]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:25:57.083459 7763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 713813e95ca045b98dfd7671eb4ddb24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:25:57.092202 8012 tablet_bootstrap.cc:492] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61: Bootstrap starting.
I20260812 00:25:57.096298 8013 tablet_bootstrap.cc:492] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430: Bootstrap starting.
I20260812 00:25:57.096939 8012 tablet_bootstrap.cc:654] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61: Neither blocks nor log segments found. Creating new log.
I20260812 00:25:57.098623 8012 log.cc:824] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61: Log is configured to *not* fsync() on all Append() calls
I20260812 00:25:57.099231 8014 tablet_bootstrap.cc:492] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25: Bootstrap starting.
I20260812 00:25:57.100442 8013 tablet_bootstrap.cc:654] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430: Neither blocks nor log segments found. Creating new log.
I20260812 00:25:57.101859 8013 log.cc:824] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430: Log is configured to *not* fsync() on all Append() calls
I20260812 00:25:57.102988 8014 tablet_bootstrap.cc:654] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25: Neither blocks nor log segments found. Creating new log.
I20260812 00:25:57.103143 8012 tablet_bootstrap.cc:492] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61: No bootstrap required, opened a new log
I20260812 00:25:57.103471 8012 ts_tablet_manager.cc:1397] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.007s
I20260812 00:25:57.104194 8014 log.cc:824] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25: Log is configured to *not* fsync() on all Append() calls
I20260812 00:25:57.105412 8013 tablet_bootstrap.cc:492] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430: No bootstrap required, opened a new log
I20260812 00:25:57.105759 8013 ts_tablet_manager.cc:1397] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.004s
I20260812 00:25:57.106966 8014 tablet_bootstrap.cc:492] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25: No bootstrap required, opened a new log
I20260812 00:25:57.107280 8014 ts_tablet_manager.cc:1397] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 00:25:57.115060 8012 raft_consensus.cc:348] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ec04933d824c4f925304243b8f7b61" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33133 } } peers { permanent_uuid: "fd08063cc2db46cca1da6f9b0445cd25" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39681 } } peers { permanent_uuid: "0b9df842672749bba91d63366ed1b430" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34191 } }
I20260812 00:25:57.115641 8012 raft_consensus.cc:374] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:25:57.115435 8014 raft_consensus.cc:348] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ec04933d824c4f925304243b8f7b61" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33133 } } peers { permanent_uuid: "fd08063cc2db46cca1da6f9b0445cd25" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39681 } } peers { permanent_uuid: "0b9df842672749bba91d63366ed1b430" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34191 } }
I20260812 00:25:57.115749 8012 raft_consensus.cc:729] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ec04933d824c4f925304243b8f7b61, State: Initialized, Role: FOLLOWER
I20260812 00:25:57.115912 8014 raft_consensus.cc:374] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:25:57.116048 8014 raft_consensus.cc:729] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd08063cc2db46cca1da6f9b0445cd25, State: Initialized, Role: FOLLOWER
I20260812 00:25:57.116688 8014 consensus_queue.cc:260] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ec04933d824c4f925304243b8f7b61" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33133 } } peers { permanent_uuid: "fd08063cc2db46cca1da6f9b0445cd25" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39681 } } peers { permanent_uuid: "0b9df842672749bba91d63366ed1b430" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34191 } }
I20260812 00:25:57.116639 8012 consensus_queue.cc:260] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ec04933d824c4f925304243b8f7b61" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33133 } } peers { permanent_uuid: "fd08063cc2db46cca1da6f9b0445cd25" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39681 } } peers { permanent_uuid: "0b9df842672749bba91d63366ed1b430" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34191 } }
I20260812 00:25:57.117003 8013 raft_consensus.cc:348] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ec04933d824c4f925304243b8f7b61" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33133 } } peers { permanent_uuid: "fd08063cc2db46cca1da6f9b0445cd25" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39681 } } peers { permanent_uuid: "0b9df842672749bba91d63366ed1b430" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34191 } }
I20260812 00:25:57.117542 8013 raft_consensus.cc:374] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:25:57.117703 8013 raft_consensus.cc:729] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9df842672749bba91d63366ed1b430, State: Initialized, Role: FOLLOWER
I20260812 00:25:57.118422 7990 heartbeater.cc:503] Master 127.18.163.254:44643 was elected leader, sending a full tablet report...
I20260812 00:25:57.118459 8013 consensus_queue.cc:260] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ec04933d824c4f925304243b8f7b61" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33133 } } peers { permanent_uuid: "fd08063cc2db46cca1da6f9b0445cd25" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39681 } } peers { permanent_uuid: "0b9df842672749bba91d63366ed1b430" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34191 } }
I20260812 00:25:57.118834 8012 ts_tablet_manager.cc:1428] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61: Time spent starting tablet: real 0.015s user 0.015s sys 0.001s
I20260812 00:25:57.120064 7837 heartbeater.cc:503] Master 127.18.163.254:44643 was elected leader, sending a full tablet report...
I20260812 00:25:57.121444 8013 ts_tablet_manager.cc:1428] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
I20260812 00:25:57.123075 8014 ts_tablet_manager.cc:1428] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25: Time spent starting tablet: real 0.016s user 0.010s sys 0.004s
I20260812 00:25:57.125300 8018 raft_consensus.cc:482] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:25:57.125623 8018 raft_consensus.cc:504] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ec04933d824c4f925304243b8f7b61" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33133 } } peers { permanent_uuid: "fd08063cc2db46cca1da6f9b0445cd25" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39681 } } peers { permanent_uuid: "0b9df842672749bba91d63366ed1b430" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34191 } }
I20260812 00:25:57.127681 8018 leader_election.cc:288] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ec04933d824c4f925304243b8f7b61 (127.18.163.195:33133), 0b9df842672749bba91d63366ed1b430 (127.18.163.193:34191)
I20260812 00:25:57.135414 8006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.127963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:44305 (local address 127.18.163.195:33133)
0812 00:25:57.128234 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:57.128243 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:57.129265 (+ 1022us) server_negotiation.cc:407] Connection header received
0812 00:25:57.129479 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:57.129483 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:57.129551 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:57.129731 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:57.130418 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.131180 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.133245 (+ 2065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.134375 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.134501 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:57.134573 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:57.134970 (+ 397us) server_negotiation.cc:299] Negotiation successful
0812 00:25:57.135119 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 00:25:57.135533 8024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.127942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:33133 (local address 127.18.163.194:44305)
0812 00:25:57.129114 (+ 1172us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:57.129141 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:57.129343 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:57.129757 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:57.129762 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:57.129804 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:57.130228 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:57.130242 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.131311 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.131316 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:57.133065 (+ 1749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:57.133078 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.134619 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.134626 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:57.134798 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:57.134838 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 00:25:57.134947 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 00:25:57.135093 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":966,"thread_start_us":734,"threads_started":1}
I20260812 00:25:57.136234 8009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.128417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:33449 (local address 127.18.163.193:34191)
0812 00:25:57.128692 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:57.128699 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:57.130093 (+ 1394us) server_negotiation.cc:407] Connection header received
0812 00:25:57.130203 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:57.130211 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:57.130291 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:57.130381 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:25:57.130954 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.131995 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.134028 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.135132 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.135296 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:57.135367 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:57.135827 (+ 460us) server_negotiation.cc:299] Negotiation successful
0812 00:25:57.135978 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:25:57.136831 8025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.128186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:34191 (local address 127.18.163.194:33449)
0812 00:25:57.129982 (+ 1796us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:57.129996 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:57.130097 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:57.130437 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:57.130441 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:57.130464 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:25:57.130799 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:57.130806 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.132155 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.132159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:57.133865 (+ 1706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:57.133880 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.135364 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.135370 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:57.135595 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:57.135639 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 00:25:57.136430 (+ 791us) client_negotiation.cc:240] Negotiation successful
0812 00:25:57.136556 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1676,"thread_start_us":1473,"threads_started":1}
I20260812 00:25:57.136754 7942 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "713813e95ca045b98dfd7671eb4ddb24" candidate_uuid: "fd08063cc2db46cca1da6f9b0445cd25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ec04933d824c4f925304243b8f7b61" is_pre_election: true
I20260812 00:25:57.137434 7942 raft_consensus.cc:2454] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd08063cc2db46cca1da6f9b0445cd25 in term 0.
I20260812 00:25:57.138051 7636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "713813e95ca045b98dfd7671eb4ddb24" candidate_uuid: "fd08063cc2db46cca1da6f9b0445cd25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9df842672749bba91d63366ed1b430" is_pre_election: true
I20260812 00:25:57.138216 7711 leader_election.cc:302] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ec04933d824c4f925304243b8f7b61, fd08063cc2db46cca1da6f9b0445cd25; no voters:
I20260812 00:25:57.138574 7636 raft_consensus.cc:2454] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd08063cc2db46cca1da6f9b0445cd25 in term 0.
I20260812 00:25:57.138614 8018 raft_consensus.cc:2781] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:25:57.138772 8018 raft_consensus.cc:482] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:25:57.138895 8018 raft_consensus.cc:3037] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:25:57.141335 8018 raft_consensus.cc:504] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ec04933d824c4f925304243b8f7b61" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33133 } } peers { permanent_uuid: "fd08063cc2db46cca1da6f9b0445cd25" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39681 } } peers { permanent_uuid: "0b9df842672749bba91d63366ed1b430" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34191 } }
I20260812 00:25:57.142125 8018 leader_election.cc:288] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [CANDIDATE]: Term 1 election: Requested vote from peers 74ec04933d824c4f925304243b8f7b61 (127.18.163.195:33133), 0b9df842672749bba91d63366ed1b430 (127.18.163.193:34191)
I20260812 00:25:57.142571 7942 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "713813e95ca045b98dfd7671eb4ddb24" candidate_uuid: "fd08063cc2db46cca1da6f9b0445cd25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ec04933d824c4f925304243b8f7b61"
I20260812 00:25:57.142699 7636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "713813e95ca045b98dfd7671eb4ddb24" candidate_uuid: "fd08063cc2db46cca1da6f9b0445cd25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9df842672749bba91d63366ed1b430"
I20260812 00:25:57.142799 7942 raft_consensus.cc:3037] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:25:57.142959 7636 raft_consensus.cc:3037] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:25:57.145895 7942 raft_consensus.cc:2454] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd08063cc2db46cca1da6f9b0445cd25 in term 1.
I20260812 00:25:57.145921 7636 raft_consensus.cc:2454] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd08063cc2db46cca1da6f9b0445cd25 in term 1.
I20260812 00:25:57.146390 7711 leader_election.cc:302] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ec04933d824c4f925304243b8f7b61, fd08063cc2db46cca1da6f9b0445cd25; no voters:
I20260812 00:25:57.146809 8018 raft_consensus.cc:2781] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:25:57.147320 8018 raft_consensus.cc:686] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [term 1 LEADER]: Becoming Leader. State: Replica: fd08063cc2db46cca1da6f9b0445cd25, State: Running, Role: LEADER
I20260812 00:25:57.147836 8018 consensus_queue.cc:237] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ec04933d824c4f925304243b8f7b61" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33133 } } peers { permanent_uuid: "fd08063cc2db46cca1da6f9b0445cd25" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39681 } } peers { permanent_uuid: "0b9df842672749bba91d63366ed1b430" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34191 } }
I20260812 00:25:57.152978 7477 catalog_manager.cc:5495] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd08063cc2db46cca1da6f9b0445cd25 (127.18.163.194). New cstate: current_term: 1 leader_uuid: "fd08063cc2db46cca1da6f9b0445cd25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ec04933d824c4f925304243b8f7b61" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd08063cc2db46cca1da6f9b0445cd25" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9df842672749bba91d63366ed1b430" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34191 } health_report { overall_health: UNKNOWN } } }
I20260812 00:25:57.183399 8011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.177246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58390 (local address 127.18.163.194:39681)
0812 00:25:57.177527 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:57.177532 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:57.177557 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:25:57.177832 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:57.177836 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:57.177932 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:57.178067 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:25:57.178519 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.179329 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.181049 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.181454 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.181553 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:57.182174 (+ 621us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:25:57.182706 (+ 532us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:25:57.182839 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:57.182986 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 00:25:57.183059 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260812 00:25:57.189340 7991 tablet.cc:2369] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:25:57.192723 7636 raft_consensus.cc:1261] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430 [term 1 FOLLOWER]: Refusing update from remote peer fd08063cc2db46cca1da6f9b0445cd25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:25:57.192723 7942 raft_consensus.cc:1261] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61 [term 1 FOLLOWER]: Refusing update from remote peer fd08063cc2db46cca1da6f9b0445cd25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:25:57.193871 8018 consensus_queue.cc:1035] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9df842672749bba91d63366ed1b430" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 34191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:25:57.194216 8026 consensus_queue.cc:1035] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ec04933d824c4f925304243b8f7b61" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:25:57.209839 8032 mvcc.cc:205] Tried to move back new op lower bound from 7317480887050764288 to 7317480886881497088. Current Snapshot: MvccSnapshot[applied={T|T < 7317480887050764288}]
I20260812 00:25:57.223167 7477 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:25:57.223472 7477 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:25:57.227648 7477 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5fbab54363f5471c923df935ebcc2b38: Sending DeleteTablet for 3 replicas of tablet 713813e95ca045b98dfd7671eb4ddb24
I20260812 00:25:57.229092 7612 tablet_service.cc:1514] Processing DeleteTablet for tablet 713813e95ca045b98dfd7671eb4ddb24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:25:57 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:34184
I20260812 00:25:57.229102 7915 tablet_service.cc:1514] Processing DeleteTablet for tablet 713813e95ca045b98dfd7671eb4ddb24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:25:57 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:46714
I20260812 00:25:57.230552 7763 tablet_service.cc:1514] Processing DeleteTablet for tablet 713813e95ca045b98dfd7671eb4ddb24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:25:57 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:58380
I20260812 00:25:57.231078 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 7544
I20260812 00:25:57.253526 8041 tablet_replica.cc:330] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25: stopping tablet replica
I20260812 00:25:57.254163 8041 raft_consensus.cc:2229] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:25:57.254969 8041 raft_consensus.cc:2258] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:25:57.259156 8040 tablet_replica.cc:330] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430: stopping tablet replica
I20260812 00:25:57.259815 8040 raft_consensus.cc:2229] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430 [term 1 FOLLOWER]: Raft consensus shutting down.
Aug 12 00:25:57 dist-test-slave-njxd krb5kdc[7426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:25:57.260677 8040 raft_consensus.cc:2258] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:25:57.260828 8041 ts_tablet_manager.cc:1905] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:25:57.261415 8039 tablet_replica.cc:330] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61: stopping tablet replica
I20260812 00:25:57.262486 8039 raft_consensus.cc:2229] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:25:57.263064 8039 raft_consensus.cc:2258] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:25:57.265297 8040 ts_tablet_manager.cc:1905] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:25:57.270114 8041 ts_tablet_manager.cc:1918] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:25:57.270560 8041 log.cc:1196] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/713813e95ca045b98dfd7671eb4ddb24
I20260812 00:25:57.271184 8009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.232514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34190 (local address 127.18.163.193:34191)
0812 00:25:57.232724 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:57.232731 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:57.244904 (+ 12173us) server_negotiation.cc:407] Connection header received
0812 00:25:57.245263 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:57.245271 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:57.245370 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:57.245468 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:57.247624 (+ 2156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.248932 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.251086 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.251818 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.251947 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:57.261817 (+ 9870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:57.261831 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:57.261847 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:57.261911 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:57.266433 (+ 4522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:57.267532 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:57.267542 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:57.267546 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:57.267747 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:57.268289 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:57.268294 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:57.268297 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:57.268763 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:57.269071 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:57.270461 (+ 1390us) server_negotiation.cc:299] Negotiation successful
0812 00:25:57.270734 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 00:25:57.271730 8041 ts_tablet_manager.cc:1939] T 713813e95ca045b98dfd7671eb4ddb24 P fd08063cc2db46cca1da6f9b0445cd25: Deleting consensus metadata
I20260812 00:25:57.271998 7680 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:57.273162 8039 ts_tablet_manager.cc:1905] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:25:57.273826 7460 catalog_manager.cc:4841] TS fd08063cc2db46cca1da6f9b0445cd25 (127.18.163.194:39681): tablet 713813e95ca045b98dfd7671eb4ddb24 (table test-table [id=11eed8abf48c4512bccb23c432b0e096]) successfully deleted
I20260812 00:25:57.282034 8039 ts_tablet_manager.cc:1918] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:25:57.282269 8039 log.cc:1196] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/713813e95ca045b98dfd7671eb4ddb24
I20260812 00:25:57.282768 8039 ts_tablet_manager.cc:1939] T 713813e95ca045b98dfd7671eb4ddb24 P 74ec04933d824c4f925304243b8f7b61: Deleting consensus metadata
I20260812 00:25:57.284777 7460 catalog_manager.cc:4841] TS 74ec04933d824c4f925304243b8f7b61 (127.18.163.195:33133): tablet 713813e95ca045b98dfd7671eb4ddb24 (table test-table [id=11eed8abf48c4512bccb23c432b0e096]) successfully deleted
I20260812 00:25:57.404073 8040 ts_tablet_manager.cc:1918] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:25:57.404311 8040 log.cc:1196] T 713813e95ca045b98dfd7671eb4ddb24 P 0b9df842672749bba91d63366ed1b430: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/713813e95ca045b98dfd7671eb4ddb24
I20260812 00:25:57.404450 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 7544
I20260812 00:25:57.429378 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 7691
W20260812 00:25:57.429404 7461 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.163.193:34191 (error 108)
I20260812 00:25:57.432082 8008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.431483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:34191 (local address 127.0.0.1:34198)
0812 00:25:57.431737 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:57.431870 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:34191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260812 00:25:57.432401 7461 catalog_manager.cc:4584] TS 0b9df842672749bba91d63366ed1b430 (127.18.163.193:34191): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 713813e95ca045b98dfd7671eb4ddb24: Network error: Client connection negotiation failed: client connection to 127.18.163.193:34191: connect: Connection refused (error 111)
Aug 12 00:25:57 dist-test-slave-njxd krb5kdc[7426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
I20260812 00:25:57.448338 8011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.431136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58396 (local address 127.18.163.194:39681)
0812 00:25:57.431358 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:57.431364 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:57.431385 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:25:57.431464 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:57.431469 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:57.431563 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:57.431677 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:57.433290 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.434326 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.435773 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.436331 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.436482 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:57.441347 (+ 4865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:57.441369 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:57.441386 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:57.441430 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:57.444882 (+ 3452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:57.445827 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:57.445839 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:57.445841 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:57.446015 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:57.446496 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:57.446502 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:57.446507 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:57.446960 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:57.447376 (+ 416us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:57.447650 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 00:25:57.447920 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 00:25:57.449167 7832 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:57.486338 8008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.485845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:34191 (local address 127.0.0.1:34214)
0812 00:25:57.486081 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:57.486182 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:34191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260812 00:25:57.487686 8008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.487231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:34191 (local address 127.0.0.1:34222)
0812 00:25:57.487435 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:57.487512 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:34191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 00:25:57.548245 8008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.547753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:34191 (local address 127.0.0.1:34232)
0812 00:25:57.547990 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:57.548085 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:34191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260812 00:25:57.549631 8008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.549115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:34191 (local address 127.0.0.1:34246)
0812 00:25:57.549319 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:57.549402 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:34191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260812 00:25:57.571658 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 7691
I20260812 00:25:57.597528 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 7844
Aug 12 00:25:57 dist-test-slave-njxd krb5kdc[7426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:25:57.614735 8006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.598403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46720 (local address 127.18.163.195:33133)
0812 00:25:57.598587 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:57.598591 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:57.598613 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:25:57.598820 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:57.598825 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:57.598901 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:57.599011 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:57.600386 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.601166 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.602860 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:57.603276 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:57.603387 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:57.608260 (+ 4873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:57.608279 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:57.608295 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:25:57.608338 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:57.611467 (+ 3129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:57.612314 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:57.612323 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:57.612325 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:57.612479 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:25:57.613042 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:25:57.613046 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:25:57.613048 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:25:57.613434 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:57.613813 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:57.614232 (+ 419us) server_negotiation.cc:299] Negotiation successful
0812 00:25:57.614429 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 00:25:57.615438 7985 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:57.630643 8008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.630005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:34191 (local address 127.0.0.1:34248)
0812 00:25:57.630274 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:57.630418 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:34191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260812 00:25:57.632014 8008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.631499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:34191 (local address 127.0.0.1:34256)
0812 00:25:57.631735 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:57.631845 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:34191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260812 00:25:57.709026 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 7844
I20260812 00:25:57.733798 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 7442
I20260812 00:25:57.735064 7510 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:25:57.850854 8008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:57.849323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:34191 (local address 127.0.0.1:34258)
0812 00:25:57.850508 (+ 1185us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:57.850622 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.193:34191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":801}
I20260812 00:25:57.851089 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 7442
2026-08-12T00:25:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4927 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T00:25:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:25:57Z Disabled control of system clock
I20260812 00:25:57.963241 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44771
--webserver_interface=127.18.163.254
--webserver_port=0
--builtin_ntp_servers=127.18.163.212:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:44771
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:25:58.338814 8052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:58.339272 8052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:58.339387 8052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:58.347463 8052 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:25:58.347604 8052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:58.347641 8052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:58.347693 8052 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:25:58.347740 8052 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:25:58.357434 8052 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:44771
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:58.358840 8052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:58.360687 8052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:58.373778 8058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:58.373909 8060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:58.373792 8057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:58.374842 8052 server_base.cc:1034] running on GCE node
I20260812 00:25:58.375689 8052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:58.377355 8052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:58.378618 8052 hybrid_clock.cc:648] HybridClock initialized: now 1786494358378578 us; error 53 us; skew 500 ppm
I20260812 00:25:58.379025 8052 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:25:58.381709 8052 webserver.cc:460] Webserver started at http://127.18.163.254:46733/ using document root <none> and password file <none>
I20260812 00:25:58.382503 8052 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:58.382654 8052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:58.383008 8052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:25:58.386422 8052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "d5d96de4a6694a03afcb57a45c69d2bc"
format_stamp: "Formatted at 2026-08-12 00:25:58 on dist-test-slave-njxd"
server_key: "b7c4a40eaaac118f5aa2dbab93cb9a76"
server_key_iv: "7ee1c029fbabae33125c75942310f0e8"
server_key_version: "encryptionkey@0"
I20260812 00:25:58.387315 8052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "d5d96de4a6694a03afcb57a45c69d2bc"
format_stamp: "Formatted at 2026-08-12 00:25:58 on dist-test-slave-njxd"
server_key: "b7c4a40eaaac118f5aa2dbab93cb9a76"
server_key_iv: "7ee1c029fbabae33125c75942310f0e8"
server_key_version: "encryptionkey@0"
I20260812 00:25:58.393011 8052 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260812 00:25:58.397038 8067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:58.398679 8052 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:25:58.398919 8052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "d5d96de4a6694a03afcb57a45c69d2bc"
format_stamp: "Formatted at 2026-08-12 00:25:58 on dist-test-slave-njxd"
server_key: "b7c4a40eaaac118f5aa2dbab93cb9a76"
server_key_iv: "7ee1c029fbabae33125c75942310f0e8"
server_key_version: "encryptionkey@0"
I20260812 00:25:58.399197 8052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:58.426249 8052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:58.427263 8052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:58.427595 8052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:58.448019 8052 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:44771
I20260812 00:25:58.448041 8125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:44771 every 8 connection(s)
I20260812 00:25:58.449512 8052 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:25:58.453655 8126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:25:58.455018 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 8052
I20260812 00:25:58.455211 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:25:58.455695 19087 external_mini_cluster.cc:1428] Setting key 9dee8e2480863ba57088f181b9e1b05c
I20260812 00:25:58.469437 8126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc: Bootstrap starting.
I20260812 00:25:58.471711 8130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:58.457855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54140 (local address 127.18.163.254:44771)
0812 00:25:58.459023 (+ 1168us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:58.459039 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:58.459107 (+ 68us) server_negotiation.cc:407] Connection header received
0812 00:25:58.460867 (+ 1760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:58.460900 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:58.461594 (+ 694us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:58.462089 (+ 495us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:58.462656 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:58.464586 (+ 1930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:58.466054 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:58.467224 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:58.467416 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:58.468644 (+ 1228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:58.468656 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:58.468676 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:25:58.469449 (+ 773us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:58.469564 (+ 115us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:25:58.469620 (+ 56us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:58.469749 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:58.469979 (+ 230us) server_negotiation.cc:299] Negotiation successful
0812 00:25:58.470327 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":363,"threads_started":1}
I20260812 00:25:58.473796 8126 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc: Neither blocks nor log segments found. Creating new log.
I20260812 00:25:58.475096 8126 log.cc:824] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc: Log is configured to *not* fsync() on all Append() calls
I20260812 00:25:58.477995 8126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc: No bootstrap required, opened a new log
I20260812 00:25:58.485529 8126 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5d96de4a6694a03afcb57a45c69d2bc" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44771 } }
I20260812 00:25:58.486044 8126 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:25:58.486158 8126 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5d96de4a6694a03afcb57a45c69d2bc, State: Initialized, Role: FOLLOWER
I20260812 00:25:58.486758 8126 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5d96de4a6694a03afcb57a45c69d2bc" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44771 } }
I20260812 00:25:58.487040 8126 raft_consensus.cc:388] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:25:58.487219 8126 raft_consensus.cc:482] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:25:58.487424 8126 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:25:58.489782 8126 raft_consensus.cc:504] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5d96de4a6694a03afcb57a45c69d2bc" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44771 } }
I20260812 00:25:58.490329 8126 leader_election.cc:302] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d5d96de4a6694a03afcb57a45c69d2bc; no voters:
I20260812 00:25:58.490978 8126 leader_election.cc:288] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:25:58.491165 8132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:25:58.491947 8132 raft_consensus.cc:686] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [term 1 LEADER]: Becoming Leader. State: Replica: d5d96de4a6694a03afcb57a45c69d2bc, State: Running, Role: LEADER
I20260812 00:25:58.492596 8132 consensus_queue.cc:237] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5d96de4a6694a03afcb57a45c69d2bc" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44771 } }
I20260812 00:25:58.493422 8126 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:25:58.495975 8134 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5d96de4a6694a03afcb57a45c69d2bc. Latest consensus state: current_term: 1 leader_uuid: "d5d96de4a6694a03afcb57a45c69d2bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5d96de4a6694a03afcb57a45c69d2bc" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44771 } } }
I20260812 00:25:58.495973 8133 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d5d96de4a6694a03afcb57a45c69d2bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5d96de4a6694a03afcb57a45c69d2bc" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44771 } } }
I20260812 00:25:58.496529 8134 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [sys.catalog]: This master's current role is: LEADER
I20260812 00:25:58.496554 8133 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc [sys.catalog]: This master's current role is: LEADER
I20260812 00:25:58.499306 8140 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:25:58.504966 8140 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:25:58.515748 8140 catalog_manager.cc:1347] Generated new cluster ID: 8c55d0e2e32c41fd9e25918e490c9bd3
I20260812 00:25:58.515892 8140 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:25:58.539345 8140 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:25:58.541353 8140 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:25:58.550227 8140 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc: Generated new TSK 0
I20260812 00:25:58.551483 8140 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:25:58.570827 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44771
--builtin_ntp_servers=127.18.163.212:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:25:58.953492 8154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:58.953917 8154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:58.954094 8154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:58.962172 8154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:58.962352 8154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:58.962549 8154 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:25:58.972505 8154 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44771
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:58.974138 8154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:58.976116 8154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:58.990401 8163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:58.990517 8160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:58.990607 8159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:58.991788 8154 server_base.cc:1034] running on GCE node
I20260812 00:25:58.992501 8154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:58.993731 8154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:58.994947 8154 hybrid_clock.cc:648] HybridClock initialized: now 1786494358994876 us; error 71 us; skew 500 ppm
I20260812 00:25:58.995256 8154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:25:58.997931 8154 webserver.cc:460] Webserver started at http://127.18.163.193:35101/ using document root <none> and password file <none>
I20260812 00:25:58.998764 8154 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:58.998864 8154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:58.999148 8154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:25:59.002455 8154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "e6e4eed6bab54455913757e0d8f7fc3b"
format_stamp: "Formatted at 2026-08-12 00:25:58 on dist-test-slave-njxd"
server_key: "e4961b4f140dfa524458a2325c15c857"
server_key_iv: "fdec3c08b4601bc728b1cc09d1fafbde"
server_key_version: "encryptionkey@0"
I20260812 00:25:59.003481 8154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "e6e4eed6bab54455913757e0d8f7fc3b"
format_stamp: "Formatted at 2026-08-12 00:25:58 on dist-test-slave-njxd"
server_key: "e4961b4f140dfa524458a2325c15c857"
server_key_iv: "fdec3c08b4601bc728b1cc09d1fafbde"
server_key_version: "encryptionkey@0"
I20260812 00:25:59.009357 8154 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 00:25:59.013293 8169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:59.014904 8154 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:25:59.015118 8154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "e6e4eed6bab54455913757e0d8f7fc3b"
format_stamp: "Formatted at 2026-08-12 00:25:58 on dist-test-slave-njxd"
server_key: "e4961b4f140dfa524458a2325c15c857"
server_key_iv: "fdec3c08b4601bc728b1cc09d1fafbde"
server_key_version: "encryptionkey@0"
I20260812 00:25:59.015383 8154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:59.030452 8154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:59.031409 8154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:59.031783 8154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:59.032886 8154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:25:59.034646 8154 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:25:59.034785 8154 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:59.034968 8154 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:25:59.035076 8154 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:59.071934 8154 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:46717
I20260812 00:25:59.071988 8292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:46717 every 8 connection(s)
I20260812 00:25:59.074200 8154 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:25:59.080225 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 8154
I20260812 00:25:59.080435 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:25:59.081044 19087 external_mini_cluster.cc:1428] Setting key cebc31653e27d0786e728818763fe27d
I20260812 00:25:59.084352 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44771
--builtin_ntp_servers=127.18.163.212:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:25:59.090844 8295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:59.077903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:57473 (local address 127.18.163.254:44771)
0812 00:25:59.078449 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:59.078454 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:59.079506 (+ 1052us) server_negotiation.cc:407] Connection header received
0812 00:25:59.082183 (+ 2677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:59.082194 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:59.082309 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:59.082439 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:59.083891 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:59.084733 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:59.087482 (+ 2749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:59.087921 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:59.088032 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:59.089969 (+ 1937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:59.089974 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:59.089978 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:25:59.090000 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:59.090051 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:25:59.090065 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:59.090142 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:59.090448 (+ 306us) server_negotiation.cc:299] Negotiation successful
0812 00:25:59.090548 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":282,"threads_started":1}
I20260812 00:25:59.092486 8296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:59.078378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44771 (local address 127.18.163.193:57473)
0812 00:25:59.079322 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:59.079359 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:59.081821 (+ 2462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:59.082668 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:59.082677 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:59.082778 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:25:59.083692 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:59.083723 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:59.084910 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:59.084919 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:59.087299 (+ 2380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:59.087321 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:59.088204 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:59.088215 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:59.088595 (+ 380us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:59.089489 (+ 894us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:25:59.089495 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:25:59.089560 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:25:59.089719 (+ 159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:25:59.090182 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:25:59.090197 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:25:59.090208 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:25:59.090413 (+ 205us) client_negotiation.cc:240] Negotiation successful
0812 00:25:59.090911 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":284,"threads_started":1}
I20260812 00:25:59.094427 8293 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44771
I20260812 00:25:59.094787 8293 heartbeater.cc:464] Registering TS with master...
I20260812 00:25:59.095623 8293 heartbeater.cc:511] Master 127.18.163.254:44771 requested a full tablet report, sending...
I20260812 00:25:59.097877 8088 ts_manager.cc:194] Registered new tserver with Master: e6e4eed6bab54455913757e0d8f7fc3b (127.18.163.193:46717)
I20260812 00:25:59.099444 8088 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.163.193:57473
W20260812 00:25:59.464498 8298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:59.464954 8298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:59.465096 8298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:59.475544 8298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:59.475674 8298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:59.475790 8298 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:25:59.485402 8298 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44771
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:25:59.486866 8298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:25:59.488786 8298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:25:59.503830 8304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:59.503851 8305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:25:59.503883 8307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:25:59.504611 8298 server_base.cc:1034] running on GCE node
I20260812 00:25:59.505394 8298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:25:59.506505 8298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:25:59.507738 8298 hybrid_clock.cc:648] HybridClock initialized: now 1786494359507673 us; error 48 us; skew 500 ppm
I20260812 00:25:59.508097 8298 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:25:59.510735 8298 webserver.cc:460] Webserver started at http://127.18.163.194:40327/ using document root <none> and password file <none>
I20260812 00:25:59.511546 8298 fs_manager.cc:359] Metadata directory not provided
I20260812 00:25:59.511673 8298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:25:59.512042 8298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:25:59.515456 8298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd"
format_stamp: "Formatted at 2026-08-12 00:25:59 on dist-test-slave-njxd"
server_key: "cfe2df72ee9030645865c7e133a37db8"
server_key_iv: "24e0d95f853f32a8804cfd03385bea8c"
server_key_version: "encryptionkey@0"
I20260812 00:25:59.516395 8298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd"
format_stamp: "Formatted at 2026-08-12 00:25:59 on dist-test-slave-njxd"
server_key: "cfe2df72ee9030645865c7e133a37db8"
server_key_iv: "24e0d95f853f32a8804cfd03385bea8c"
server_key_version: "encryptionkey@0"
I20260812 00:25:59.522557 8298 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260812 00:25:59.526661 8314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:59.528311 8298 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:25:59.528517 8298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd"
format_stamp: "Formatted at 2026-08-12 00:25:59 on dist-test-slave-njxd"
server_key: "cfe2df72ee9030645865c7e133a37db8"
server_key_iv: "24e0d95f853f32a8804cfd03385bea8c"
server_key_version: "encryptionkey@0"
I20260812 00:25:59.528779 8298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:25:59.550272 8298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:25:59.551358 8298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:25:59.551681 8298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:25:59.552747 8298 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:25:59.554483 8298 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:25:59.554652 8298 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:59.554782 8298 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:25:59.554837 8298 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:25:59.591255 8298 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:41709
I20260812 00:25:59.591290 8434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:41709 every 8 connection(s)
I20260812 00:25:59.592768 8298 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:25:59.594893 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 8298
I20260812 00:25:59.595103 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:25:59.595767 19087 external_mini_cluster.cc:1428] Setting key e5c8f558c4ba1a4e724fedcb19895792
I20260812 00:25:59.599017 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44771
--builtin_ntp_servers=127.18.163.212:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:25:59.608541 8438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:59.595946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:37587 (local address 127.18.163.254:44771)
0812 00:25:59.596466 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0812 00:25:59.596473 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:25:59.600333 (+ 3860us) server_negotiation.cc:407] Connection header received
0812 00:25:59.600403 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:25:59.600408 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:25:59.600486 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:25:59.600618 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:25:59.602032 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:59.603088 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:59.605309 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:25:59.605857 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:25:59.606010 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:59.607589 (+ 1579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:25:59.607598 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:25:59.607602 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:25:59.607623 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:25:59.607670 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:25:59.607683 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:25:59.607788 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 00:25:59.608037 (+ 249us) server_negotiation.cc:299] Negotiation successful
0812 00:25:59.608165 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":263,"threads_started":1}
I20260812 00:25:59.609764 8440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:25:59.596695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44771 (local address 127.18.163.194:37587)
0812 00:25:59.597946 (+ 1251us) negotiation.cc:107] Waiting for socket to connect
0812 00:25:59.598005 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 00:25:59.599960 (+ 1955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:25:59.600922 (+ 962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:25:59.600932 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:25:59.601045 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:25:59.601807 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:59.601828 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:59.603319 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:59.603326 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:59.605109 (+ 1783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:25:59.605126 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:25:59.606125 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:25:59.606133 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:25:59.606393 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:25:59.607205 (+ 812us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:25:59.607208 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:25:59.607255 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:25:59.607352 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:25:59.607789 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:25:59.607805 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:25:59.607816 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:25:59.608027 (+ 211us) client_negotiation.cc:240] Negotiation successful
0812 00:25:59.608500 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":395,"threads_started":1}
I20260812 00:25:59.611382 8436 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44771
I20260812 00:25:59.611779 8436 heartbeater.cc:464] Registering TS with master...
I20260812 00:25:59.612820 8436 heartbeater.cc:511] Master 127.18.163.254:44771 requested a full tablet report, sending...
I20260812 00:25:59.614765 8088 ts_manager.cc:194] Registered new tserver with Master: 1ecef4ee839748c7b6d0bdc8ac85e8bd (127.18.163.194:41709)
I20260812 00:25:59.615682 8088 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.163.194:37587
W20260812 00:25:59.980935 8441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:25:59.981267 8441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:25:59.981441 8441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:25:59.989403 8441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:25:59.989537 8441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:25:59.989758 8441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:25:59.999750 8441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:44771
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:00.001187 8441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:00.003291 8441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:00.017419 8448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:00.017446 8449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:00.017800 8452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:00.018395 8441 server_base.cc:1034] running on GCE node
I20260812 00:26:00.019193 8441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:00.020370 8441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:00.021684 8441 hybrid_clock.cc:648] HybridClock initialized: now 1786494360021629 us; error 46 us; skew 500 ppm
I20260812 00:26:00.022063 8441 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:26:00.024641 8441 webserver.cc:460] Webserver started at http://127.18.163.195:43897/ using document root <none> and password file <none>
I20260812 00:26:00.025484 8441 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:00.025653 8441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:00.026104 8441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:00.029282 8441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "152f88bda9b140f691cffbc3566dbe42"
format_stamp: "Formatted at 2026-08-12 00:26:00 on dist-test-slave-njxd"
server_key: "7a412055026d1512ae60e9c93a2bad9e"
server_key_iv: "fd590ca2b6df65771b372b3b5bde7cf2"
server_key_version: "encryptionkey@0"
I20260812 00:26:00.030215 8441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "152f88bda9b140f691cffbc3566dbe42"
format_stamp: "Formatted at 2026-08-12 00:26:00 on dist-test-slave-njxd"
server_key: "7a412055026d1512ae60e9c93a2bad9e"
server_key_iv: "fd590ca2b6df65771b372b3b5bde7cf2"
server_key_version: "encryptionkey@0"
I20260812 00:26:00.036211 8441 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260812 00:26:00.040390 8458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:00.042061 8441 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 00:26:00.042279 8441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "152f88bda9b140f691cffbc3566dbe42"
format_stamp: "Formatted at 2026-08-12 00:26:00 on dist-test-slave-njxd"
server_key: "7a412055026d1512ae60e9c93a2bad9e"
server_key_iv: "fd590ca2b6df65771b372b3b5bde7cf2"
server_key_version: "encryptionkey@0"
I20260812 00:26:00.042551 8441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:00.069917 8441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:00.070906 8441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:00.071273 8441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:00.072427 8441 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:26:00.074186 8441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:26:00.074283 8441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:00.074443 8441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:26:00.074523 8441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:00.103144 8293 heartbeater.cc:503] Master 127.18.163.254:44771 was elected leader, sending a full tablet report...
I20260812 00:26:00.111639 8441 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:38817
I20260812 00:26:00.111692 8582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:38817 every 8 connection(s)
I20260812 00:26:00.113088 8441 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:26:00.119217 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 8441
I20260812 00:26:00.119406 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:26:00.119943 19087 external_mini_cluster.cc:1428] Setting key 506b0a7f28473f38844ac3e3100187b4
I20260812 00:26:00.127079 8585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.116009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:34399 (local address 127.18.163.254:44771)
0812 00:26:00.116501 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:00.116506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:00.117716 (+ 1210us) server_negotiation.cc:407] Connection header received
0812 00:26:00.119878 (+ 2162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:00.119885 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:00.119990 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:00.120133 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:00.121683 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.122599 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.124374 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.124794 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.124899 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.126316 (+ 1417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:00.126321 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:00.126324 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:00.126344 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:00.126386 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:00.126398 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:00.126472 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:00.126689 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 00:26:00.126780 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":270,"threads_started":1}
I20260812 00:26:00.128266 8586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.116527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44771 (local address 127.18.163.195:34399)
0812 00:26:00.117477 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:00.117515 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:00.119493 (+ 1978us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:00.120445 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:00.120461 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:00.120570 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:00.121418 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:00.121448 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.122781 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.122786 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:00.124232 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:00.124246 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.125008 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.125013 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:00.125236 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.125973 (+ 737us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:26:00.125976 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:00.126021 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:26:00.126115 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:00.126491 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:00.126500 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:00.126506 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:26:00.126660 (+ 154us) client_negotiation.cc:240] Negotiation successful
0812 00:26:00.126996 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":288,"threads_started":1}
I20260812 00:26:00.129805 8583 heartbeater.cc:347] Connected to a master server at 127.18.163.254:44771
I20260812 00:26:00.130147 8583 heartbeater.cc:464] Registering TS with master...
I20260812 00:26:00.130993 8583 heartbeater.cc:511] Master 127.18.163.254:44771 requested a full tablet report, sending...
I20260812 00:26:00.132705 8088 ts_manager.cc:194] Registered new tserver with Master: 152f88bda9b140f691cffbc3566dbe42 (127.18.163.195:38817)
I20260812 00:26:00.133850 8088 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.163.195:34399
I20260812 00:26:00.135831 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:26:00.147164 8585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.140828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54142 (local address 127.18.163.254:44771)
0812 00:26:00.141019 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:00.141024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:00.141413 (+ 389us) server_negotiation.cc:407] Connection header received
0812 00:26:00.141569 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:00.141617 (+ 48us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:00.141708 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:00.141799 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:00.142290 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.143102 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.144505 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.144920 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.145015 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.146298 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:00.146303 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:00.146306 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:00.146326 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:00.146361 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:00.146374 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:00.146493 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:00.146746 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 00:26:00.146800 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 00:26:00.151897 8087 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54142:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:26:00.159027 8087 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:26:00.195175 8598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.171986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:46717 (local address 127.0.0.1:49820)
0812 00:26:00.185183 (+ 13197us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:00.185203 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:00.185326 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:00.186581 (+ 1255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:00.186592 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:00.186646 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:26:00.187236 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:00.187253 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.189824 (+ 2571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.189830 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:00.191930 (+ 2100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:00.191946 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.194158 (+ 2212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.194164 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:00.194322 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.194365 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 00:26:00.194468 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 00:26:00.194724 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12262,"mutex_wait_us":121,"thread_start_us":12556,"threads_started":1}
I20260812 00:26:00.195696 8603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.173758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44204 (local address 127.18.163.195:38817)
0812 00:26:00.185884 (+ 12126us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:00.185893 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:00.185931 (+ 38us) server_negotiation.cc:407] Connection header received
0812 00:26:00.186052 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:00.186062 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:00.186312 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:00.188061 (+ 1749us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:26:00.188380 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.189877 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.192848 (+ 2971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.194469 (+ 1621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.194740 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.194991 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:00.195094 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 00:26:00.195234 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11944,"thread_start_us":11737,"threads_started":1}
I20260812 00:26:00.196031 8601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.172472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:38817 (local address 127.0.0.1:44204)
0812 00:26:00.184668 (+ 12196us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:00.184725 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:00.184980 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:00.187356 (+ 2376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:00.187363 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:00.187394 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:26:00.187813 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:00.187825 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.190035 (+ 2210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.190040 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:00.192550 (+ 2510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:00.192568 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.194723 (+ 2155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.194730 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:00.194918 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.194949 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 00:26:00.195033 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 00:26:00.195193 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11955,"mutex_wait_us":68,"thread_start_us":11807,"threads_started":1}
I20260812 00:26:00.196520 8599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.172487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:41709 (local address 127.0.0.1:36530)
0812 00:26:00.187074 (+ 14587us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:00.187103 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:00.187238 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:00.187853 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:00.187857 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:00.187888 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:26:00.188268 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:00.188278 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.190035 (+ 1757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.190040 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:00.192750 (+ 2710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:00.192765 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.195527 (+ 2762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.195536 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:00.195717 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.195752 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 00:26:00.195931 (+ 179us) client_negotiation.cc:240] Negotiation successful
0812 00:26:00.196081 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14434,"mutex_wait_us":1,"thread_start_us":14268,"threads_started":1}
I20260812 00:26:00.196543 8602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.173125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36530 (local address 127.18.163.194:41709)
0812 00:26:00.187346 (+ 14221us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:00.187356 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:00.187389 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:26:00.187485 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:00.187491 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:00.187664 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:00.187870 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:26:00.188465 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.189855 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.192992 (+ 3137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.194479 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.194684 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.194945 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:00.196003 (+ 1058us) server_negotiation.cc:299] Negotiation successful
0812 00:26:00.196201 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14027,"thread_start_us":13853,"threads_started":1}
I20260812 00:26:00.197256 8600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.172429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49820 (local address 127.18.163.193:46717)
0812 00:26:00.184040 (+ 11611us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:00.184053 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:00.185495 (+ 1442us) server_negotiation.cc:407] Connection header received
0812 00:26:00.185671 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:00.185681 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:00.186001 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:00.186224 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:26:00.187431 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.189200 (+ 1769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.192184 (+ 2984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.193777 (+ 1593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.194008 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.195698 (+ 1690us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:00.195775 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 00:26:00.196287 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11368,"thread_start_us":11194,"threads_started":1}
I20260812 00:26:00.200477 8367 tablet_service.cc:1467] Processing CreateTablet for tablet 82ea276d3db64d01981c156e998589bb (DEFAULT_TABLE table=test-table [id=ed1ca54b16d345cfbb35eb220f11647d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:26:00.200805 8222 tablet_service.cc:1467] Processing CreateTablet for tablet 82ea276d3db64d01981c156e998589bb (DEFAULT_TABLE table=test-table [id=ed1ca54b16d345cfbb35eb220f11647d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:26:00.200805 8510 tablet_service.cc:1467] Processing CreateTablet for tablet 82ea276d3db64d01981c156e998589bb (DEFAULT_TABLE table=test-table [id=ed1ca54b16d345cfbb35eb220f11647d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:26:00.202129 8367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82ea276d3db64d01981c156e998589bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:00.202395 8510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82ea276d3db64d01981c156e998589bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:00.202395 8222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82ea276d3db64d01981c156e998589bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:00.215306 8604 tablet_bootstrap.cc:492] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd: Bootstrap starting.
I20260812 00:26:00.218695 8605 tablet_bootstrap.cc:492] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b: Bootstrap starting.
I20260812 00:26:00.221124 8606 tablet_bootstrap.cc:492] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42: Bootstrap starting.
I20260812 00:26:00.221429 8604 tablet_bootstrap.cc:654] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:00.222834 8605 tablet_bootstrap.cc:654] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:00.222992 8604 log.cc:824] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:00.224184 8605 log.cc:824] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:00.225121 8606 tablet_bootstrap.cc:654] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:00.226372 8606 log.cc:824] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:00.227434 8604 tablet_bootstrap.cc:492] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd: No bootstrap required, opened a new log
I20260812 00:26:00.227687 8605 tablet_bootstrap.cc:492] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b: No bootstrap required, opened a new log
I20260812 00:26:00.227766 8604 ts_tablet_manager.cc:1397] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.004s
I20260812 00:26:00.228118 8605 ts_tablet_manager.cc:1397] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260812 00:26:00.229707 8606 tablet_bootstrap.cc:492] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42: No bootstrap required, opened a new log
I20260812 00:26:00.229979 8606 ts_tablet_manager.cc:1397] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260812 00:26:00.236241 8605 raft_consensus.cc:348] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e4eed6bab54455913757e0d8f7fc3b" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46717 } } peers { permanent_uuid: "152f88bda9b140f691cffbc3566dbe42" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 38817 } } peers { permanent_uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41709 } }
I20260812 00:26:00.236703 8605 raft_consensus.cc:374] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:00.236804 8605 raft_consensus.cc:729] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e4eed6bab54455913757e0d8f7fc3b, State: Initialized, Role: FOLLOWER
I20260812 00:26:00.237638 8605 consensus_queue.cc:260] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e4eed6bab54455913757e0d8f7fc3b" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46717 } } peers { permanent_uuid: "152f88bda9b140f691cffbc3566dbe42" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 38817 } } peers { permanent_uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41709 } }
I20260812 00:26:00.239389 8604 raft_consensus.cc:348] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e4eed6bab54455913757e0d8f7fc3b" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46717 } } peers { permanent_uuid: "152f88bda9b140f691cffbc3566dbe42" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 38817 } } peers { permanent_uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41709 } }
I20260812 00:26:00.239920 8604 raft_consensus.cc:374] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:00.240015 8604 raft_consensus.cc:729] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ecef4ee839748c7b6d0bdc8ac85e8bd, State: Initialized, Role: FOLLOWER
I20260812 00:26:00.240722 8604 consensus_queue.cc:260] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e4eed6bab54455913757e0d8f7fc3b" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46717 } } peers { permanent_uuid: "152f88bda9b140f691cffbc3566dbe42" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 38817 } } peers { permanent_uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41709 } }
I20260812 00:26:00.241560 8606 raft_consensus.cc:348] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e4eed6bab54455913757e0d8f7fc3b" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46717 } } peers { permanent_uuid: "152f88bda9b140f691cffbc3566dbe42" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 38817 } } peers { permanent_uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41709 } }
I20260812 00:26:00.242086 8606 raft_consensus.cc:374] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:00.242192 8606 raft_consensus.cc:729] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 152f88bda9b140f691cffbc3566dbe42, State: Initialized, Role: FOLLOWER
I20260812 00:26:00.242389 8436 heartbeater.cc:503] Master 127.18.163.254:44771 was elected leader, sending a full tablet report...
I20260812 00:26:00.242949 8604 ts_tablet_manager.cc:1428] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd: Time spent starting tablet: real 0.015s user 0.006s sys 0.008s
I20260812 00:26:00.242867 8606 consensus_queue.cc:260] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e4eed6bab54455913757e0d8f7fc3b" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46717 } } peers { permanent_uuid: "152f88bda9b140f691cffbc3566dbe42" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 38817 } } peers { permanent_uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41709 } }
I20260812 00:26:00.245191 8605 ts_tablet_manager.cc:1428] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b: Time spent starting tablet: real 0.017s user 0.006s sys 0.010s
I20260812 00:26:00.246657 8583 heartbeater.cc:503] Master 127.18.163.254:44771 was elected leader, sending a full tablet report...
I20260812 00:26:00.247193 8606 ts_tablet_manager.cc:1428] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42: Time spent starting tablet: real 0.017s user 0.013s sys 0.003s
W20260812 00:26:00.329402 8294 tablet.cc:2369] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:26:00.345075 8437 tablet.cc:2369] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:26:00.365170 8584 tablet.cc:2369] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:26:00.409425 8612 raft_consensus.cc:482] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:26:00.409775 8612 raft_consensus.cc:504] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e4eed6bab54455913757e0d8f7fc3b" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46717 } } peers { permanent_uuid: "152f88bda9b140f691cffbc3566dbe42" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 38817 } } peers { permanent_uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41709 } }
I20260812 00:26:00.411573 8612 leader_election.cc:288] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e4eed6bab54455913757e0d8f7fc3b (127.18.163.193:46717), 1ecef4ee839748c7b6d0bdc8ac85e8bd (127.18.163.194:41709)
I20260812 00:26:00.413966 8610 raft_consensus.cc:482] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:26:00.414309 8610 raft_consensus.cc:504] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e4eed6bab54455913757e0d8f7fc3b" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46717 } } peers { permanent_uuid: "152f88bda9b140f691cffbc3566dbe42" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 38817 } } peers { permanent_uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41709 } }
I20260812 00:26:00.416574 8610 leader_election.cc:288] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 152f88bda9b140f691cffbc3566dbe42 (127.18.163.195:38817), 1ecef4ee839748c7b6d0bdc8ac85e8bd (127.18.163.194:41709)
I20260812 00:26:00.421039 8602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.412314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:35937 (local address 127.18.163.194:41709)
0812 00:26:00.412513 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:00.412520 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:00.412543 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:26:00.412633 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:00.412640 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:00.412756 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:00.412866 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:26:00.413342 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.414450 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.417045 (+ 2595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.418768 (+ 1723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.418997 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.419109 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:00.420417 (+ 1308us) server_negotiation.cc:299] Negotiation successful
0812 00:26:00.420636 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:26:00.421667 8586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.411874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:41709 (local address 127.18.163.195:35937)
0812 00:26:00.412122 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:00.412146 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:00.412316 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:00.412957 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:00.412961 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:00.412989 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:26:00.413174 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:00.413183 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.414624 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.414630 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:00.416813 (+ 2183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:00.416831 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.419285 (+ 2454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.419295 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:00.419567 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.419624 (+ 57us) client_negotiation.cc:769] Sending connection context
0812 00:26:00.419741 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 00:26:00.419964 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":1}
I20260812 00:26:00.423839 8387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ea276d3db64d01981c156e998589bb" candidate_uuid: "152f88bda9b140f691cffbc3566dbe42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd" is_pre_election: true
I20260812 00:26:00.424424 8614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.412010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:46717 (local address 127.18.163.195:40707)
0812 00:26:00.413040 (+ 1030us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:00.413055 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:00.413221 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:00.413633 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:00.413638 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:00.413665 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:26:00.414032 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:00.414044 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.415408 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.415419 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:00.417174 (+ 1755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:00.417192 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.423229 (+ 6037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.423235 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:00.423468 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.423508 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 00:26:00.423860 (+ 352us) client_negotiation.cc:240] Negotiation successful
0812 00:26:00.424019 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":885,"mutex_wait_us":2,"thread_start_us":630,"threads_started":1}
I20260812 00:26:00.424551 8387 raft_consensus.cc:2454] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 152f88bda9b140f691cffbc3566dbe42 in term 0.
I20260812 00:26:00.425354 8459 leader_election.cc:302] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 152f88bda9b140f691cffbc3566dbe42, 1ecef4ee839748c7b6d0bdc8ac85e8bd; no voters:
I20260812 00:26:00.425686 8600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.412469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:40707 (local address 127.18.163.193:46717)
0812 00:26:00.412731 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:00.412739 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:00.413150 (+ 411us) server_negotiation.cc:407] Connection header received
0812 00:26:00.413412 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:00.413416 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:00.413483 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:00.413556 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:26:00.414260 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.415242 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.417824 (+ 2582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.419637 (+ 1813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.419832 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.419939 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:00.423755 (+ 3816us) server_negotiation.cc:299] Negotiation successful
0812 00:26:00.425300 (+ 1545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1318,"server-negotiator.queue_time_us":112}
I20260812 00:26:00.425990 8612 raft_consensus.cc:2781] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:26:00.426180 8612 raft_consensus.cc:482] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:26:00.426309 8612 raft_consensus.cc:3037] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:00.427663 8243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ea276d3db64d01981c156e998589bb" candidate_uuid: "152f88bda9b140f691cffbc3566dbe42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e4eed6bab54455913757e0d8f7fc3b" is_pre_election: true
I20260812 00:26:00.428222 8243 raft_consensus.cc:2454] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 152f88bda9b140f691cffbc3566dbe42 in term 0.
I20260812 00:26:00.429733 8612 raft_consensus.cc:504] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e4eed6bab54455913757e0d8f7fc3b" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46717 } } peers { permanent_uuid: "152f88bda9b140f691cffbc3566dbe42" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 38817 } } peers { permanent_uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41709 } }
I20260812 00:26:00.430567 8612 leader_election.cc:288] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [CANDIDATE]: Term 1 election: Requested vote from peers e6e4eed6bab54455913757e0d8f7fc3b (127.18.163.193:46717), 1ecef4ee839748c7b6d0bdc8ac85e8bd (127.18.163.194:41709)
I20260812 00:26:00.431157 8387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ea276d3db64d01981c156e998589bb" candidate_uuid: "152f88bda9b140f691cffbc3566dbe42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd"
I20260812 00:26:00.431408 8387 raft_consensus.cc:3037] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:00.431550 8243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ea276d3db64d01981c156e998589bb" candidate_uuid: "152f88bda9b140f691cffbc3566dbe42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e4eed6bab54455913757e0d8f7fc3b"
I20260812 00:26:00.431802 8243 raft_consensus.cc:3037] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:00.432252 8603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.417442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:40253 (local address 127.18.163.195:38817)
0812 00:26:00.417660 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:00.417669 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:00.422808 (+ 5139us) server_negotiation.cc:407] Connection header received
0812 00:26:00.423151 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:00.423160 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:00.423269 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:00.423345 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:26:00.424585 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.426175 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.429667 (+ 3492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.430982 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.431155 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.431232 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:00.431844 (+ 612us) server_negotiation.cc:299] Negotiation successful
0812 00:26:00.431999 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 00:26:00.433051 8616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.416953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:38817 (local address 127.18.163.193:40253)
0812 00:26:00.422684 (+ 5731us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:00.422711 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:00.422954 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:00.423598 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:00.423605 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:00.423640 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:26:00.424362 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:00.424379 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.426480 (+ 2101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.426488 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:00.429397 (+ 2909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:00.429421 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.431392 (+ 1971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.431402 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:00.431606 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.431644 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:26:00.432411 (+ 767us) client_negotiation.cc:240] Negotiation successful
0812 00:26:00.432573 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5554,"mutex_wait_us":44,"thread_start_us":5291,"threads_started":1}
I20260812 00:26:00.434458 8532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ea276d3db64d01981c156e998589bb" candidate_uuid: "e6e4eed6bab54455913757e0d8f7fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "152f88bda9b140f691cffbc3566dbe42" is_pre_election: true
I20260812 00:26:00.435070 8532 raft_consensus.cc:2379] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6e4eed6bab54455913757e0d8f7fc3b in current term 1: Already voted for candidate 152f88bda9b140f691cffbc3566dbe42 in this term.
I20260812 00:26:00.435030 8387 raft_consensus.cc:2454] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 152f88bda9b140f691cffbc3566dbe42 in term 1.
I20260812 00:26:00.435525 8459 leader_election.cc:302] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 152f88bda9b140f691cffbc3566dbe42, 1ecef4ee839748c7b6d0bdc8ac85e8bd; no voters:
I20260812 00:26:00.436296 8243 raft_consensus.cc:2454] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 152f88bda9b140f691cffbc3566dbe42 in term 1.
I20260812 00:26:00.436383 8612 raft_consensus.cc:2781] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:00.436939 8612 raft_consensus.cc:686] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [term 1 LEADER]: Becoming Leader. State: Replica: 152f88bda9b140f691cffbc3566dbe42, State: Running, Role: LEADER
I20260812 00:26:00.437181 8617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.417110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:41709 (local address 127.18.163.193:39215)
0812 00:26:00.428562 (+ 11452us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:00.428587 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:00.428809 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:00.429342 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:00.429345 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:00.429365 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:26:00.429773 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:00.429785 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.431230 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.431236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:00.433771 (+ 2535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:00.433790 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.436250 (+ 2460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.436259 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:00.436467 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.436505 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:26:00.436602 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 00:26:00.436797 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9495,"thread_start_us":9090,"threads_started":1}
I20260812 00:26:00.437423 8602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.417528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:39215 (local address 127.18.163.194:41709)
0812 00:26:00.421372 (+ 3844us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:00.421381 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:00.428683 (+ 7302us) server_negotiation.cc:407] Connection header received
0812 00:26:00.428970 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:00.428976 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:00.429087 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:00.429153 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:26:00.429949 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.431047 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.434435 (+ 3388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.435829 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.435964 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.436039 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:00.436962 (+ 923us) server_negotiation.cc:299] Negotiation successful
0812 00:26:00.437127 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3702,"thread_start_us":5189,"threads_started":1}
I20260812 00:26:00.437654 8612 consensus_queue.cc:237] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e4eed6bab54455913757e0d8f7fc3b" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46717 } } peers { permanent_uuid: "152f88bda9b140f691cffbc3566dbe42" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 38817 } } peers { permanent_uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41709 } }
I20260812 00:26:00.438054 8387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ea276d3db64d01981c156e998589bb" candidate_uuid: "e6e4eed6bab54455913757e0d8f7fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd" is_pre_election: true
I20260812 00:26:00.438405 8387 raft_consensus.cc:2379] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6e4eed6bab54455913757e0d8f7fc3b in current term 1: Already voted for candidate 152f88bda9b140f691cffbc3566dbe42 in this term.
I20260812 00:26:00.439188 8170 leader_election.cc:302] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e4eed6bab54455913757e0d8f7fc3b; no voters: 152f88bda9b140f691cffbc3566dbe42, 1ecef4ee839748c7b6d0bdc8ac85e8bd
I20260812 00:26:00.439607 8610 raft_consensus.cc:2726] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 00:26:00.443356 8087 catalog_manager.cc:5495] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 152f88bda9b140f691cffbc3566dbe42 (127.18.163.195). New cstate: current_term: 1 leader_uuid: "152f88bda9b140f691cffbc3566dbe42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e4eed6bab54455913757e0d8f7fc3b" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "152f88bda9b140f691cffbc3566dbe42" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 38817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41709 } health_report { overall_health: UNKNOWN } } }
I20260812 00:26:00.498121 8603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.492576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44218 (local address 127.18.163.195:38817)
0812 00:26:00.492765 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:00.492770 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:00.492838 (+ 68us) server_negotiation.cc:407] Connection header received
0812 00:26:00.493044 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:00.493048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:00.493161 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:00.493298 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:00.493714 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.494514 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.495931 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.496362 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.496456 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.497004 (+ 548us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:00.497528 (+ 524us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:00.497773 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:00.497832 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 00:26:00.497874 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:26:00.507478 8387 raft_consensus.cc:1261] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd [term 1 FOLLOWER]: Refusing update from remote peer 152f88bda9b140f691cffbc3566dbe42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:26:00.507524 8243 raft_consensus.cc:1261] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b [term 1 FOLLOWER]: Refusing update from remote peer 152f88bda9b140f691cffbc3566dbe42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:26:00.508575 8619 consensus_queue.cc:1035] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e4eed6bab54455913757e0d8f7fc3b" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:26:00.508927 8612 consensus_queue.cc:1035] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ecef4ee839748c7b6d0bdc8ac85e8bd" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 41709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:26:00.541172 8087 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:26:00.541507 8087 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:26:00.546113 8087 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d5d96de4a6694a03afcb57a45c69d2bc: Sending DeleteTablet for 3 replicas of tablet 82ea276d3db64d01981c156e998589bb
I20260812 00:26:00.547538 8222 tablet_service.cc:1514] Processing DeleteTablet for tablet 82ea276d3db64d01981c156e998589bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:26:00 UTC) from {username='slave'} at 127.0.0.1:49820
I20260812 00:26:00.547590 8510 tablet_service.cc:1514] Processing DeleteTablet for tablet 82ea276d3db64d01981c156e998589bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:26:00 UTC) from {username='slave'} at 127.0.0.1:44204
I20260812 00:26:00.547991 8367 tablet_service.cc:1514] Processing DeleteTablet for tablet 82ea276d3db64d01981c156e998589bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:26:00 UTC) from {username='slave'} at 127.0.0.1:36530
I20260812 00:26:00.550034 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 8154
I20260812 00:26:00.562615 8634 tablet_replica.cc:330] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42: stopping tablet replica
I20260812 00:26:00.562888 8636 tablet_replica.cc:330] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd: stopping tablet replica
I20260812 00:26:00.563525 8636 raft_consensus.cc:2229] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:26:00.564206 8636 raft_consensus.cc:2258] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:26:00.565327 8634 raft_consensus.cc:2229] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:26:00.565546 8635 tablet_replica.cc:330] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b: stopping tablet replica
I20260812 00:26:00.566022 8635 raft_consensus.cc:2229] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:26:00.566169 8634 raft_consensus.cc:2258] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:26:00.566573 8635 raft_consensus.cc:2258] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:26:00.568145 8636 ts_tablet_manager.cc:1905] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:26:00.568612 8635 ts_tablet_manager.cc:1905] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:26:00.570402 8634 ts_tablet_manager.cc:1905] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:26:00.576311 8636 ts_tablet_manager.cc:1918] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:26:00.576538 8635 ts_tablet_manager.cc:1918] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:26:00.576622 8636 log.cc:1196] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/82ea276d3db64d01981c156e998589bb
I20260812 00:26:00.576737 8635 log.cc:1196] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/82ea276d3db64d01981c156e998589bb
I20260812 00:26:00.577328 8635 ts_tablet_manager.cc:1939] T 82ea276d3db64d01981c156e998589bb P e6e4eed6bab54455913757e0d8f7fc3b: Deleting consensus metadata
I20260812 00:26:00.577536 8636 ts_tablet_manager.cc:1939] T 82ea276d3db64d01981c156e998589bb P 1ecef4ee839748c7b6d0bdc8ac85e8bd: Deleting consensus metadata
I20260812 00:26:00.579633 8069 catalog_manager.cc:4841] TS e6e4eed6bab54455913757e0d8f7fc3b (127.18.163.193:46717): tablet 82ea276d3db64d01981c156e998589bb (table test-table [id=ed1ca54b16d345cfbb35eb220f11647d]) successfully deleted
I20260812 00:26:00.579664 8068 catalog_manager.cc:4841] TS 1ecef4ee839748c7b6d0bdc8ac85e8bd (127.18.163.194:41709): tablet 82ea276d3db64d01981c156e998589bb (table test-table [id=ed1ca54b16d345cfbb35eb220f11647d]) successfully deleted
I20260812 00:26:00.581964 8634 ts_tablet_manager.cc:1918] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:26:00.582206 8634 log.cc:1196] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/82ea276d3db64d01981c156e998589bb
I20260812 00:26:00.582723 8634 ts_tablet_manager.cc:1939] T 82ea276d3db64d01981c156e998589bb P 152f88bda9b140f691cffbc3566dbe42: Deleting consensus metadata
I20260812 00:26:00.583110 8600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.552503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49828 (local address 127.18.163.193:46717)
0812 00:26:00.552735 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:00.552744 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:00.558883 (+ 6139us) server_negotiation.cc:407] Connection header received
0812 00:26:00.560342 (+ 1459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:00.560352 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:00.560517 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:00.560637 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:00.562992 (+ 2355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.564709 (+ 1717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.572929 (+ 8220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.573735 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.573871 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.580610 (+ 6739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:00.580624 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:00.580644 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:00.581512 (+ 868us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:00.581667 (+ 155us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:00.581704 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:00.581841 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:00.582576 (+ 735us) server_negotiation.cc:299] Negotiation successful
0812 00:26:00.582717 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 00:26:00.584017 8287 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:00.584856 8071 catalog_manager.cc:4841] TS 152f88bda9b140f691cffbc3566dbe42 (127.18.163.195:38817): tablet 82ea276d3db64d01981c156e998589bb (table test-table [id=ed1ca54b16d345cfbb35eb220f11647d]) successfully deleted
I20260812 00:26:00.709436 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 8154
I20260812 00:26:00.734014 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 8298
I20260812 00:26:00.741488 8602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.734924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36542 (local address 127.18.163.194:41709)
0812 00:26:00.735153 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:00.735160 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:00.735183 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:26:00.735313 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:00.735319 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:00.735419 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:00.735530 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:00.735979 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.736743 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.738145 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.738656 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.738798 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.739968 (+ 1170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:00.739977 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:00.739993 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:00.740652 (+ 659us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:00.740706 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:00.740727 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:00.740864 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:00.741016 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 00:26:00.741153 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 00:26:00.742264 8429 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:00.836916 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 8298
I20260812 00:26:00.863893 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 8441
I20260812 00:26:00.886716 8603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:00.864813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44222 (local address 127.18.163.195:38817)
0812 00:26:00.865034 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:00.865043 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:00.865075 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:26:00.865151 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:00.865157 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:00.865317 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:00.865458 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:00.865940 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.867084 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.868545 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:00.869380 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:00.869637 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:00.884546 (+ 14909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:00.884562 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:00.884584 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:00.885638 (+ 1054us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:00.885736 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:00.885779 (+ 43us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:00.885943 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:00.886195 (+ 252us) server_negotiation.cc:299] Negotiation successful
0812 00:26:00.886345 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260812 00:26:00.887609 8578 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:01.031250 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 8441
I20260812 00:26:01.058239 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 8052
I20260812 00:26:01.059440 8121 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:01.175920 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 8052
2026-08-12T00:26:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3323 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:01 dist-test-slave-njxd krb5kdc[8645](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:01 dist-test-slave-njxd krb5kdc[8645](info): set up 2 sockets
Aug 12 00:26:01 dist-test-slave-njxd krb5kdc[8645](info): commencing operation
krb5kdc: starting...
W20260812 00:26:02.413807 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.188s user 0.003s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:02 dist-test-slave-njxd krb5kdc[8645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:26:02.800948 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:41653
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:45401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:41653
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:03.189252 8660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:03.189638 8660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:03.189844 8660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:03.197518 8660 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:03.197762 8660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:03.197870 8660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:03.197974 8660 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:03.198048 8660 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:03.208729 8660 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:45401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:41653
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:41653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:03.210201 8660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:03.211601 8660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:03.224764 8666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:03.224673 8669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:03.224723 8667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:03.225533 8660 server_base.cc:1034] running on GCE node
I20260812 00:26:03.226634 8660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:03.228224 8660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:03.229480 8660 hybrid_clock.cc:648] HybridClock initialized: now 1786494363229403 us; error 59 us; skew 500 ppm
I20260812 00:26:03.229938 8660 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:03 dist-test-slave-njxd krb5kdc[8645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494363, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:03.233414 8660 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:26:03.235142 8660 webserver.cc:460] Webserver started at http://127.18.163.254:32915/ using document root <none> and password file <none>
I20260812 00:26:03.235931 8660 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:03.236083 8660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:03.236442 8660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:03.239945 8660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "4b349274372f4df69a2f63988bba0c84"
format_stamp: "Formatted at 2026-08-12 00:26:03 on dist-test-slave-njxd"
server_key: "fbb897987784eafcaf8750a79d2555b7"
server_key_iv: "937301557c0457473b2151c96c7ef8cb"
server_key_version: "encryptionkey@0"
I20260812 00:26:03.240818 8660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "4b349274372f4df69a2f63988bba0c84"
format_stamp: "Formatted at 2026-08-12 00:26:03 on dist-test-slave-njxd"
server_key: "fbb897987784eafcaf8750a79d2555b7"
server_key_iv: "937301557c0457473b2151c96c7ef8cb"
server_key_version: "encryptionkey@0"
I20260812 00:26:03.246719 8660 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260812 00:26:03.250658 8677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:03.252120 8660 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:26:03.252338 8660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "4b349274372f4df69a2f63988bba0c84"
format_stamp: "Formatted at 2026-08-12 00:26:03 on dist-test-slave-njxd"
server_key: "fbb897987784eafcaf8750a79d2555b7"
server_key_iv: "937301557c0457473b2151c96c7ef8cb"
server_key_version: "encryptionkey@0"
I20260812 00:26:03.252559 8660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:03.280692 8660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:03.284945 8660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:03.285279 8660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:03.305336 8660 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:41653
I20260812 00:26:03.305356 8734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:41653 every 8 connection(s)
I20260812 00:26:03.306905 8660 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:03.310611 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 8660
I20260812 00:26:03.310808 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:03.310976 8735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:03.311306 19087 external_mini_cluster.cc:1428] Setting key d192bdb25daec0d685ad7a8db70f7f9d
I20260812 00:26:03.326907 8735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84: Bootstrap starting.
Aug 12 00:26:03 dist-test-slave-njxd krb5kdc[8645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:26:03.331043 8735 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:03.332285 8735 log.cc:824] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:03.336201 8735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84: No bootstrap required, opened a new log
I20260812 00:26:03.336927 8738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:03.313173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45122 (local address 127.18.163.254:41653)
0812 00:26:03.314093 (+ 920us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:03.314107 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:03.314156 (+ 49us) server_negotiation.cc:407] Connection header received
0812 00:26:03.315990 (+ 1834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:03.316016 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:03.316476 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:03.316861 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:03.318936 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:03.320284 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:03.322218 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:03.322985 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:03.323145 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:03.328537 (+ 5392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:03.328546 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:03.328561 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:03.328605 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:03.331966 (+ 3361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:03.332950 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:03.332962 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:03.332976 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:03.333337 (+ 361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:03.333851 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:03.333856 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:03.333859 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:03.334485 (+ 626us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:03.334749 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:03.335290 (+ 541us) server_negotiation.cc:299] Negotiation successful
0812 00:26:03.335707 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":714,"thread_start_us":422,"threads_started":1}
I20260812 00:26:03.344336 8735 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b349274372f4df69a2f63988bba0c84" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 41653 } }
I20260812 00:26:03.344774 8735 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:03.344892 8735 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b349274372f4df69a2f63988bba0c84, State: Initialized, Role: FOLLOWER
I20260812 00:26:03.345495 8735 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b349274372f4df69a2f63988bba0c84" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 41653 } }
I20260812 00:26:03.345824 8735 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:03.345964 8735 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:03.346122 8735 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:03.348645 8735 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b349274372f4df69a2f63988bba0c84" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 41653 } }
I20260812 00:26:03.349220 8735 leader_election.cc:302] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b349274372f4df69a2f63988bba0c84; no voters:
I20260812 00:26:03.349925 8735 leader_election.cc:288] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:03.350081 8740 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:03.350772 8740 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [term 1 LEADER]: Becoming Leader. State: Replica: 4b349274372f4df69a2f63988bba0c84, State: Running, Role: LEADER
I20260812 00:26:03.351451 8740 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b349274372f4df69a2f63988bba0c84" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 41653 } }
I20260812 00:26:03.352180 8735 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:03.354615 8742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b349274372f4df69a2f63988bba0c84. Latest consensus state: current_term: 1 leader_uuid: "4b349274372f4df69a2f63988bba0c84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b349274372f4df69a2f63988bba0c84" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 41653 } } }
I20260812 00:26:03.355103 8742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:03.354761 8741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b349274372f4df69a2f63988bba0c84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b349274372f4df69a2f63988bba0c84" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 41653 } } }
I20260812 00:26:03.355329 8741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:03.356083 8747 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:03.362874 8747 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:03.381948 8747 catalog_manager.cc:1347] Generated new cluster ID: da96a265a35f4748808b4b582a92141a
I20260812 00:26:03.382097 8747 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:03.394447 8747 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:03.396550 8747 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:03.407523 8747 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84: Generated new TSK 0
I20260812 00:26:03.408483 8747 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.163.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
Entry for principal kudu/127.18.163.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab.
I20260812 00:26:03.500747 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:41653
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:45401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:03.880511 8762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:03.880846 8762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:03.880949 8762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:03.888682 8762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:03.888868 8762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:03.889066 8762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:26:03.899571 8762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:45401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.193.keytab
--principal=kudu/127.18.163.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:41653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:03.901082 8762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:03.902578 8762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:03.917467 8767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:03.917423 8768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:03.917500 8770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:03.918723 8762 server_base.cc:1034] running on GCE node
I20260812 00:26:03.919396 8762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:03.920480 8762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:03.921697 8762 hybrid_clock.cc:648] HybridClock initialized: now 1786494363921648 us; error 50 us; skew 500 ppm
I20260812 00:26:03.922046 8762 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:03 dist-test-slave-njxd krb5kdc[8645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494363, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:03.925858 8762 init.cc:377] Logged in from keytab as kudu/127.18.163.193@KRBTEST.COM (short username kudu)
I20260812 00:26:03.927650 8762 webserver.cc:460] Webserver started at http://127.18.163.193:35785/ using document root <none> and password file <none>
I20260812 00:26:03.928521 8762 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:03.928691 8762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:03.929051 8762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:03.932518 8762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "d440093732464f448fba5b90a2034647"
format_stamp: "Formatted at 2026-08-12 00:26:03 on dist-test-slave-njxd"
server_key: "02af47c9ce997d243b7586c85e11552f"
server_key_iv: "b4bd70a12a7ffdcd54bb4f9a0048a620"
server_key_version: "encryptionkey@0"
I20260812 00:26:03.933444 8762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "d440093732464f448fba5b90a2034647"
format_stamp: "Formatted at 2026-08-12 00:26:03 on dist-test-slave-njxd"
server_key: "02af47c9ce997d243b7586c85e11552f"
server_key_iv: "b4bd70a12a7ffdcd54bb4f9a0048a620"
server_key_version: "encryptionkey@0"
I20260812 00:26:03.939445 8762 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:26:03.943852 8777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:03.945456 8762 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:26:03.945717 8762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "d440093732464f448fba5b90a2034647"
format_stamp: "Formatted at 2026-08-12 00:26:03 on dist-test-slave-njxd"
server_key: "02af47c9ce997d243b7586c85e11552f"
server_key_iv: "b4bd70a12a7ffdcd54bb4f9a0048a620"
server_key_version: "encryptionkey@0"
I20260812 00:26:03.945966 8762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:03.971665 8762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:03.976176 8762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:03.976537 8762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:03.977720 8762 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:26:03.979342 8762 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:26:03.979455 8762 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:03.979645 8762 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:26:03.979725 8762 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:04.016243 8762 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:37383
I20260812 00:26:04.016345 8902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:37383 every 8 connection(s)
I20260812 00:26:04.017757 8762 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:26:04.020323 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 8762
I20260812 00:26:04.020537 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:26:04.021154 19087 external_mini_cluster.cc:1428] Setting key 28856de3e4b3570e115face2743b7f05
Aug 12 00:26:04 dist-test-slave-njxd krb5kdc[8645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494363, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.193@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:26:04.040656 8906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:04.020775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:36731 (local address 127.18.163.254:41653)
0812 00:26:04.021311 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:04.021324 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:04.022713 (+ 1389us) server_negotiation.cc:407] Connection header received
0812 00:26:04.025003 (+ 2290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:04.025010 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:04.025117 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:04.025248 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:04.027084 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:04.027826 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:04.029464 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:04.029947 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:04.030113 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:04.034024 (+ 3911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:04.034029 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:04.034032 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:04.034072 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:04.036919 (+ 2847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:04.037895 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:04.037899 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:04.037902 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:04.038040 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:04.038578 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:04.038582 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:04.038585 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:04.038882 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:04.039055 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:04.039979 (+ 924us) server_negotiation.cc:299] Negotiation successful
0812 00:26:04.040246 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":267,"threads_started":1}
I20260812 00:26:04.041819 8907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:04.021510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:41653 (local address 127.18.163.193:36731)
0812 00:26:04.022509 (+ 999us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:04.022562 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:04.024662 (+ 2100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:04.025526 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:04.025536 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:04.026253 (+ 717us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:04.026891 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:04.026910 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:04.028004 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:04.028010 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:04.029301 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:04.029315 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:04.030235 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:04.030244 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:04.030498 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:04.031266 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:26:04.031292 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:04.033750 (+ 2458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:04.037102 (+ 3352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:04.037112 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:04.037133 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:04.037731 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:04.038175 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:04.038180 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:04.038184 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:04.038437 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:04.039036 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:04.039045 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:04.039491 (+ 446us) client_negotiation.cc:769] Sending connection context
0812 00:26:04.039864 (+ 373us) client_negotiation.cc:240] Negotiation successful
0812 00:26:04.040471 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":408,"threads_started":1}
I20260812 00:26:04.043586 8903 heartbeater.cc:347] Connected to a master server at 127.18.163.254:41653
I20260812 00:26:04.043932 8903 heartbeater.cc:464] Registering TS with master...
I20260812 00:26:04.044719 8903 heartbeater.cc:511] Master 127.18.163.254:41653 requested a full tablet report, sending...
I20260812 00:26:04.047435 8695 ts_manager.cc:194] Registered new tserver with Master: d440093732464f448fba5b90a2034647 (127.18.163.193:37383)
I20260812 00:26:04.049938 8695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.193@KRBTEST.COM'} at 127.18.163.193:36731
WARNING: no policy specified for kudu/127.18.163.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
Entry for principal kudu/127.18.163.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab.
I20260812 00:26:04.108453 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:41653
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:45401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:04.482894 8910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:04.483208 8910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:04.483367 8910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:04.490979 8910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:04.491123 8910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:04.491303 8910 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:26:04.501857 8910 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:45401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.194.keytab
--principal=kudu/127.18.163.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:41653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:04.503306 8910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:04.504751 8910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:04.519626 8916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:04.519707 8918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:04.519972 8915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:04.520493 8910 server_base.cc:1034] running on GCE node
I20260812 00:26:04.521222 8910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:04.522364 8910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:04.523615 8910 hybrid_clock.cc:648] HybridClock initialized: now 1786494364523551 us; error 75 us; skew 500 ppm
I20260812 00:26:04.523959 8910 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:04 dist-test-slave-njxd krb5kdc[8645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494364, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:04.527526 8910 init.cc:377] Logged in from keytab as kudu/127.18.163.194@KRBTEST.COM (short username kudu)
I20260812 00:26:04.529292 8910 webserver.cc:460] Webserver started at http://127.18.163.194:39147/ using document root <none> and password file <none>
I20260812 00:26:04.530159 8910 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:04.530323 8910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:04.530684 8910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:04.534006 8910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "a5a15d9fc4f74892b1a39481c7214713"
format_stamp: "Formatted at 2026-08-12 00:26:04 on dist-test-slave-njxd"
server_key: "853206bdf6c5d4296949fcd9520808a6"
server_key_iv: "41c9a3f2efff1a64393bd7e10829bfd0"
server_key_version: "encryptionkey@0"
I20260812 00:26:04.534890 8910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "a5a15d9fc4f74892b1a39481c7214713"
format_stamp: "Formatted at 2026-08-12 00:26:04 on dist-test-slave-njxd"
server_key: "853206bdf6c5d4296949fcd9520808a6"
server_key_iv: "41c9a3f2efff1a64393bd7e10829bfd0"
server_key_version: "encryptionkey@0"
I20260812 00:26:04.540742 8910 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 00:26:04.544994 8925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:04.546684 8910 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:26:04.546895 8910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "a5a15d9fc4f74892b1a39481c7214713"
format_stamp: "Formatted at 2026-08-12 00:26:04 on dist-test-slave-njxd"
server_key: "853206bdf6c5d4296949fcd9520808a6"
server_key_iv: "41c9a3f2efff1a64393bd7e10829bfd0"
server_key_version: "encryptionkey@0"
I20260812 00:26:04.547144 8910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:04.576728 8910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:04.581243 8910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:04.581615 8910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:04.582711 8910 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:26:04.584234 8910 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:26:04.584347 8910 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:04.584501 8910 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:26:04.584575 8910 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:04.620985 8910 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:44045
I20260812 00:26:04.621034 9056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:44045 every 8 connection(s)
I20260812 00:26:04.622514 8910 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:26:04.627295 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 8910
I20260812 00:26:04.627503 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:26:04.627959 19087 external_mini_cluster.cc:1428] Setting key af182c97dceffe034363d6f37822228c
Aug 12 00:26:04 dist-test-slave-njxd krb5kdc[8645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494364, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.194@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:26:04.647106 9059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:04.625342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:46515 (local address 127.18.163.254:41653)
0812 00:26:04.625828 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:04.625833 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:04.626874 (+ 1041us) server_negotiation.cc:407] Connection header received
0812 00:26:04.629057 (+ 2183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:04.629088 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:04.629190 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:04.629307 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:04.631195 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:04.632409 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:04.634221 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:04.635034 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:04.635200 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:04.639325 (+ 4125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:04.639336 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:04.639344 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:04.639402 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:04.643271 (+ 3869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:04.644181 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:04.644190 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:04.644196 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:04.644374 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:04.644868 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:04.644876 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:04.644882 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:04.645334 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:04.645500 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:04.646321 (+ 821us) server_negotiation.cc:299] Negotiation successful
0812 00:26:04.646610 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":274,"threads_started":1}
I20260812 00:26:04.648066 9060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:04.625950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:41653 (local address 127.18.163.194:46515)
0812 00:26:04.626683 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:04.626725 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:04.628688 (+ 1963us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:04.629536 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:04.629546 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:04.630316 (+ 770us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:04.630984 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:04.631005 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:04.632595 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:04.632599 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:04.634036 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:04.634057 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:04.635286 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:04.635291 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:04.635535 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:04.636306 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:26:04.636331 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:04.638986 (+ 2655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:04.643465 (+ 4479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:04.643474 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:04.643491 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:04.644013 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:04.644501 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:04.644504 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:04.644506 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:04.644736 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:04.645465 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:04.645472 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:04.645909 (+ 437us) client_negotiation.cc:769] Sending connection context
0812 00:26:04.646157 (+ 248us) client_negotiation.cc:240] Negotiation successful
0812 00:26:04.646598 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":283,"threads_started":1}
I20260812 00:26:04.649924 9057 heartbeater.cc:347] Connected to a master server at 127.18.163.254:41653
I20260812 00:26:04.650367 9057 heartbeater.cc:464] Registering TS with master...
I20260812 00:26:04.651345 9057 heartbeater.cc:511] Master 127.18.163.254:41653 requested a full tablet report, sending...
I20260812 00:26:04.653147 8695 ts_manager.cc:194] Registered new tserver with Master: a5a15d9fc4f74892b1a39481c7214713 (127.18.163.194:44045)
I20260812 00:26:04.654189 8695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.194@KRBTEST.COM'} at 127.18.163.194:46515
WARNING: no policy specified for kudu/127.18.163.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
Entry for principal kudu/127.18.163.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab.
I20260812 00:26:04.713516 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:41653
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:45401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:26:05.053866 8903 heartbeater.cc:503] Master 127.18.163.254:41653 was elected leader, sending a full tablet report...
W20260812 00:26:05.094645 9063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:05.094967 9063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:05.095166 9063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:05.102831 9063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:05.102967 9063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:05.103157 9063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:26:05.113699 9063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:45401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.195.keytab
--principal=kudu/127.18.163.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:41653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:05.115206 9063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:05.116712 9063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:05.131692 9069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:05.131639 9071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:05.131659 9068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:05.132387 9063 server_base.cc:1034] running on GCE node
I20260812 00:26:05.133088 9063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:05.134267 9063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:05.135521 9063 hybrid_clock.cc:648] HybridClock initialized: now 1786494365135473 us; error 54 us; skew 500 ppm
I20260812 00:26:05.135888 9063 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:05 dist-test-slave-njxd krb5kdc[8645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494365, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:05.139533 9063 init.cc:377] Logged in from keytab as kudu/127.18.163.195@KRBTEST.COM (short username kudu)
I20260812 00:26:05.141281 9063 webserver.cc:460] Webserver started at http://127.18.163.195:45237/ using document root <none> and password file <none>
I20260812 00:26:05.142170 9063 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:05.142344 9063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:05.142699 9063 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:05.146119 9063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "5373e3522b3c47368865c73528ea496d"
format_stamp: "Formatted at 2026-08-12 00:26:05 on dist-test-slave-njxd"
server_key: "933d7b4c2bc55379cc5d2e8acf253774"
server_key_iv: "f394a4cb2b10b42734d3e14d6a9b2db3"
server_key_version: "encryptionkey@0"
I20260812 00:26:05.147025 9063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "5373e3522b3c47368865c73528ea496d"
format_stamp: "Formatted at 2026-08-12 00:26:05 on dist-test-slave-njxd"
server_key: "933d7b4c2bc55379cc5d2e8acf253774"
server_key_iv: "f394a4cb2b10b42734d3e14d6a9b2db3"
server_key_version: "encryptionkey@0"
I20260812 00:26:05.153841 9063 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.003s
I20260812 00:26:05.158179 9080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:05.159773 9063 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:26:05.159989 9063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "5373e3522b3c47368865c73528ea496d"
format_stamp: "Formatted at 2026-08-12 00:26:05 on dist-test-slave-njxd"
server_key: "933d7b4c2bc55379cc5d2e8acf253774"
server_key_iv: "f394a4cb2b10b42734d3e14d6a9b2db3"
server_key_version: "encryptionkey@0"
I20260812 00:26:05.160254 9063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:05.176362 9063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:05.180816 9063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:05.181165 9063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:05.182336 9063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:26:05.183797 9063 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:26:05.183908 9063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:05.184082 9063 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:26:05.184171 9063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:05.220042 9063 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:45837
I20260812 00:26:05.220098 9204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:45837 every 8 connection(s)
I20260812 00:26:05.221552 9063 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:26:05.223086 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 9063
I20260812 00:26:05.223309 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:26:05.223929 19087 external_mini_cluster.cc:1428] Setting key b917516601ef7953e67704a0e50f1d5e
Aug 12 00:26:05 dist-test-slave-njxd krb5kdc[8645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494365, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.195@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:26:05.244967 9207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:05.225876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:49871 (local address 127.18.163.254:41653)
0812 00:26:05.226491 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:05.226498 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:05.227709 (+ 1211us) server_negotiation.cc:407] Connection header received
0812 00:26:05.229756 (+ 2047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:05.229760 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:05.229837 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:05.229938 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:05.231605 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.232456 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.234184 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.234606 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.234714 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:05.238731 (+ 4017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:05.238736 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:05.238740 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:05.238779 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:05.241983 (+ 3204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:05.242826 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:05.242832 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:05.242834 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:05.242971 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:05.243394 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:05.243397 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:05.243399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:05.243672 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:05.243792 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:05.244473 (+ 681us) server_negotiation.cc:299] Negotiation successful
0812 00:26:05.244662 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":314,"threads_started":1}
I20260812 00:26:05.246122 9208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:05.226616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:41653 (local address 127.18.163.195:49871)
0812 00:26:05.227520 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:05.227589 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:05.229407 (+ 1818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:05.230180 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:05.230189 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:05.230800 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:05.231422 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:05.231442 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.232633 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.232636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:05.234022 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:05.234037 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.234840 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.234845 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:05.235063 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:05.235840 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:26:05.235864 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:05.238471 (+ 2607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:05.242147 (+ 3676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:05.242156 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:05.242172 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:05.242680 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:05.243074 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:05.243079 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:05.243081 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:05.243289 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:05.243786 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:05.243792 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:05.244144 (+ 352us) client_negotiation.cc:769] Sending connection context
0812 00:26:05.244378 (+ 234us) client_negotiation.cc:240] Negotiation successful
0812 00:26:05.244817 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":383,"threads_started":1}
I20260812 00:26:05.247793 9205 heartbeater.cc:347] Connected to a master server at 127.18.163.254:41653
I20260812 00:26:05.248143 9205 heartbeater.cc:464] Registering TS with master...
I20260812 00:26:05.249068 9205 heartbeater.cc:511] Master 127.18.163.254:41653 requested a full tablet report, sending...
I20260812 00:26:05.251143 8695 ts_manager.cc:194] Registered new tserver with Master: 5373e3522b3c47368865c73528ea496d (127.18.163.195:45837)
I20260812 00:26:05.252509 8695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.163.195@KRBTEST.COM'} at 127.18.163.195:49871
I20260812 00:26:05.253451 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:26:05.273541 9207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:05.259214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45124 (local address 127.18.163.254:41653)
0812 00:26:05.259415 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:05.259420 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:05.259875 (+ 455us) server_negotiation.cc:407] Connection header received
0812 00:26:05.260044 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:05.260048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:05.260123 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:05.260221 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:05.261800 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.262582 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.264045 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.264687 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.264796 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:05.267506 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:05.267512 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:05.267516 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:05.267555 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:05.270365 (+ 2810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:05.271424 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:05.271430 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:05.271432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:05.271590 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:05.272105 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:05.272113 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:05.272116 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:05.272503 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:05.272712 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:05.273053 (+ 341us) server_negotiation.cc:299] Negotiation successful
0812 00:26:05.273289 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:26:05.278461 8694 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45124:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:26:05.285737 8694 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:26:05.313591 9218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:05.299420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:44045 (local address 127.0.0.1:55226)
0812 00:26:05.300701 (+ 1281us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:05.300755 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:05.301003 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:05.303067 (+ 2064us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:05.303079 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:05.303123 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:26:05.303786 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:05.303803 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.306546 (+ 2743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.306556 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:05.309111 (+ 2555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:05.309128 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.311958 (+ 2830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.311968 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:05.312334 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:05.312424 (+ 90us) client_negotiation.cc:769] Sending connection context
0812 00:26:05.312598 (+ 174us) client_negotiation.cc:240] Negotiation successful
0812 00:26:05.312886 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":958,"mutex_wait_us":48,"thread_start_us":1271,"threads_started":1}
I20260812 00:26:05.315765 9221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:05.300016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55226 (local address 127.18.163.194:44045)
0812 00:26:05.302334 (+ 2318us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:05.302340 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:05.302364 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:26:05.302492 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:05.302502 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:05.302788 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:05.303823 (+ 1035us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:26:05.304152 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.306320 (+ 2168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.309324 (+ 3004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.311595 (+ 2271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.314615 (+ 3020us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:05.314885 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:05.314984 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 00:26:05.315263 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2148,"thread_start_us":2040,"threads_started":1}
I20260812 00:26:05.315786 9222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:05.300352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59988 (local address 127.18.163.195:45837)
0812 00:26:05.301878 (+ 1526us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:05.301891 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:05.302315 (+ 424us) server_negotiation.cc:407] Connection header received
0812 00:26:05.302652 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:05.302663 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:05.302946 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:05.303189 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:26:05.304719 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.306509 (+ 1790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.311725 (+ 5216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.313269 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.313440 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:05.313697 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:05.315234 (+ 1537us) server_negotiation.cc:299] Negotiation successful
0812 00:26:05.315421 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1291,"thread_start_us":1119,"threads_started":1}
I20260812 00:26:05.316821 9220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:05.299730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:45837 (local address 127.0.0.1:59988)
0812 00:26:05.302193 (+ 2463us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:05.302213 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:05.302442 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:05.303597 (+ 1155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:05.303604 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:05.303647 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:26:05.304457 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:05.304472 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.306709 (+ 2237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.306715 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:05.311496 (+ 4781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:05.311514 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.314788 (+ 3274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.314794 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:05.314993 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:05.315026 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 00:26:05.316235 (+ 1209us) client_negotiation.cc:240] Negotiation successful
0812 00:26:05.316394 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2323,"mutex_wait_us":1,"thread_start_us":2178,"threads_started":1}
I20260812 00:26:05.321817 8981 tablet_service.cc:1467] Processing CreateTablet for tablet ad8e8a421f6a4e5581f8ffb04306becc (DEFAULT_TABLE table=test-table [id=56b533feea0f4b66b20235fc7b28f45b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:26:05.324257 8981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad8e8a421f6a4e5581f8ffb04306becc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:05.331895 9128 tablet_service.cc:1467] Processing CreateTablet for tablet ad8e8a421f6a4e5581f8ffb04306becc (DEFAULT_TABLE table=test-table [id=56b533feea0f4b66b20235fc7b28f45b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:26:05.333722 9128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad8e8a421f6a4e5581f8ffb04306becc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:05.335147 9218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:05.302572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:37383 (local address 127.0.0.1:42436)
0812 00:26:05.313981 (+ 11409us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:05.314008 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:05.314158 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:05.327663 (+ 13505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:05.327669 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:05.327708 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:26:05.327923 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:05.327937 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.330275 (+ 2338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.330281 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:05.332259 (+ 1978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:05.332279 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.334314 (+ 2035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.334320 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:05.334493 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:05.334531 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:26:05.334634 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 00:26:05.334807 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11257,"thread_start_us":24504,"threads_started":1}
I20260812 00:26:05.335877 9224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:05.302785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42436 (local address 127.18.163.193:37383)
0812 00:26:05.326831 (+ 24046us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:05.326844 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:05.326889 (+ 45us) server_negotiation.cc:407] Connection header received
0812 00:26:05.327046 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:05.327058 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:05.327340 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:05.328178 (+ 838us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:26:05.328431 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.330019 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.332520 (+ 2501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.334118 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.335168 (+ 1050us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:05.335383 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:05.335470 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 00:26:05.335625 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23837,"thread_start_us":23663,"threads_started":1}
I20260812 00:26:05.339962 8831 tablet_service.cc:1467] Processing CreateTablet for tablet ad8e8a421f6a4e5581f8ffb04306becc (DEFAULT_TABLE table=test-table [id=56b533feea0f4b66b20235fc7b28f45b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:26:05.341372 8831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad8e8a421f6a4e5581f8ffb04306becc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:05.346002 9225 tablet_bootstrap.cc:492] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713: Bootstrap starting.
I20260812 00:26:05.350050 9226 tablet_bootstrap.cc:492] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d: Bootstrap starting.
I20260812 00:26:05.351583 9225 tablet_bootstrap.cc:654] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:05.353258 9225 log.cc:824] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:05.354051 9226 tablet_bootstrap.cc:654] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:05.355582 9226 log.cc:824] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:05.357416 9225 tablet_bootstrap.cc:492] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713: No bootstrap required, opened a new log
I20260812 00:26:05.357692 9229 tablet_bootstrap.cc:492] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647: Bootstrap starting.
I20260812 00:26:05.357838 9225 ts_tablet_manager.cc:1397] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260812 00:26:05.359418 9226 tablet_bootstrap.cc:492] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d: No bootstrap required, opened a new log
I20260812 00:26:05.359745 9226 ts_tablet_manager.cc:1397] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260812 00:26:05.361857 9229 tablet_bootstrap.cc:654] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:05.363307 9229 log.cc:824] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:05.366938 9225 raft_consensus.cc:348] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a15d9fc4f74892b1a39481c7214713" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44045 } } peers { permanent_uuid: "5373e3522b3c47368865c73528ea496d" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45837 } } peers { permanent_uuid: "d440093732464f448fba5b90a2034647" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 37383 } }
I20260812 00:26:05.367385 9225 raft_consensus.cc:374] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:05.367543 9225 raft_consensus.cc:729] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5a15d9fc4f74892b1a39481c7214713, State: Initialized, Role: FOLLOWER
I20260812 00:26:05.367837 9229 tablet_bootstrap.cc:492] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647: No bootstrap required, opened a new log
I20260812 00:26:05.368376 9229 ts_tablet_manager.cc:1397] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20260812 00:26:05.368355 9225 consensus_queue.cc:260] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a15d9fc4f74892b1a39481c7214713" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44045 } } peers { permanent_uuid: "5373e3522b3c47368865c73528ea496d" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45837 } } peers { permanent_uuid: "d440093732464f448fba5b90a2034647" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 37383 } }
I20260812 00:26:05.370606 9057 heartbeater.cc:503] Master 127.18.163.254:41653 was elected leader, sending a full tablet report...
I20260812 00:26:05.371491 9225 ts_tablet_manager.cc:1428] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713: Time spent starting tablet: real 0.013s user 0.011s sys 0.001s
I20260812 00:26:05.372637 9226 raft_consensus.cc:348] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a15d9fc4f74892b1a39481c7214713" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44045 } } peers { permanent_uuid: "5373e3522b3c47368865c73528ea496d" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45837 } } peers { permanent_uuid: "d440093732464f448fba5b90a2034647" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 37383 } }
I20260812 00:26:05.373172 9226 raft_consensus.cc:374] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:05.373296 9226 raft_consensus.cc:729] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5373e3522b3c47368865c73528ea496d, State: Initialized, Role: FOLLOWER
I20260812 00:26:05.374049 9226 consensus_queue.cc:260] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a15d9fc4f74892b1a39481c7214713" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44045 } } peers { permanent_uuid: "5373e3522b3c47368865c73528ea496d" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45837 } } peers { permanent_uuid: "d440093732464f448fba5b90a2034647" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 37383 } }
W20260812 00:26:05.374789 9058 tablet.cc:2369] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:26:05.378149 9205 heartbeater.cc:503] Master 127.18.163.254:41653 was elected leader, sending a full tablet report...
I20260812 00:26:05.379091 9226 ts_tablet_manager.cc:1428] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d: Time spent starting tablet: real 0.019s user 0.013s sys 0.004s
I20260812 00:26:05.379067 9229 raft_consensus.cc:348] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a15d9fc4f74892b1a39481c7214713" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44045 } } peers { permanent_uuid: "5373e3522b3c47368865c73528ea496d" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45837 } } peers { permanent_uuid: "d440093732464f448fba5b90a2034647" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 37383 } }
I20260812 00:26:05.379635 9229 raft_consensus.cc:374] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:05.379765 9229 raft_consensus.cc:729] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d440093732464f448fba5b90a2034647, State: Initialized, Role: FOLLOWER
I20260812 00:26:05.380483 9229 consensus_queue.cc:260] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a15d9fc4f74892b1a39481c7214713" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44045 } } peers { permanent_uuid: "5373e3522b3c47368865c73528ea496d" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45837 } } peers { permanent_uuid: "d440093732464f448fba5b90a2034647" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 37383 } }
I20260812 00:26:05.382560 9229 ts_tablet_manager.cc:1428] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
W20260812 00:26:05.474145 9206 tablet.cc:2369] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:26:05.521377 8905 tablet.cc:2369] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:26:05.768219 9232 raft_consensus.cc:482] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:26:05.768507 9232 raft_consensus.cc:504] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a15d9fc4f74892b1a39481c7214713" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44045 } } peers { permanent_uuid: "5373e3522b3c47368865c73528ea496d" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45837 } } peers { permanent_uuid: "d440093732464f448fba5b90a2034647" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 37383 } }
I20260812 00:26:05.770277 9232 leader_election.cc:288] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5a15d9fc4f74892b1a39481c7214713 (127.18.163.194:44045), d440093732464f448fba5b90a2034647 (127.18.163.193:37383)
I20260812 00:26:05.777652 9221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:05.770685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:47941 (local address 127.18.163.194:44045)
0812 00:26:05.770946 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:05.770956 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:05.771594 (+ 638us) server_negotiation.cc:407] Connection header received
0812 00:26:05.771814 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:05.771818 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:05.771881 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:05.771986 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:26:05.772733 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.773485 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.775638 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.776492 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.776681 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:05.776768 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:05.777148 (+ 380us) server_negotiation.cc:299] Negotiation successful
0812 00:26:05.777310 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 00:26:05.777779 9234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:05.770533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:37383 (local address 127.18.163.195:37183)
0812 00:26:05.771414 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:05.771431 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:05.771627 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:05.772000 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:05.772066 (+ 66us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:05.772136 (+ 70us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:26:05.772681 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:05.772702 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.773923 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.773935 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:05.775473 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:05.775487 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.776758 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.776765 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:05.776970 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:05.776999 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 00:26:05.777112 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 00:26:05.777330 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":756,"mutex_wait_us":52,"thread_start_us":556,"threads_started":1}
I20260812 00:26:05.777855 9235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:05.770536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:44045 (local address 127.18.163.195:47941)
0812 00:26:05.771476 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:05.771492 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:05.771654 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:05.772008 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:05.772013 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:05.772040 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:26:05.772518 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:05.772529 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.773695 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.773701 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:05.775448 (+ 1747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:05.775465 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.776684 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.776690 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:05.776915 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:05.776996 (+ 81us) client_negotiation.cc:769] Sending connection context
0812 00:26:05.777112 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 00:26:05.777333 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":817,"mutex_wait_us":175,"spinlock_wait_cycles":29952,"thread_start_us":588,"threads_started":1}
I20260812 00:26:05.778128 9224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:05.770874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:37183 (local address 127.18.163.193:37383)
0812 00:26:05.771091 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:05.771100 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:05.771548 (+ 448us) server_negotiation.cc:407] Connection header received
0812 00:26:05.771794 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:05.771798 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:05.771862 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:05.771981 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:26:05.772868 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.773728 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.775658 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.776498 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.776710 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:05.776794 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:05.777147 (+ 353us) server_negotiation.cc:299] Negotiation successful
0812 00:26:05.777314 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 00:26:05.779037 9006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad8e8a421f6a4e5581f8ffb04306becc" candidate_uuid: "5373e3522b3c47368865c73528ea496d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5a15d9fc4f74892b1a39481c7214713" is_pre_election: true
I20260812 00:26:05.779306 8856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad8e8a421f6a4e5581f8ffb04306becc" candidate_uuid: "5373e3522b3c47368865c73528ea496d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d440093732464f448fba5b90a2034647" is_pre_election: true
I20260812 00:26:05.779627 9006 raft_consensus.cc:2454] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5373e3522b3c47368865c73528ea496d in term 0.
I20260812 00:26:05.779852 8856 raft_consensus.cc:2454] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5373e3522b3c47368865c73528ea496d in term 0.
I20260812 00:26:05.780411 9082 leader_election.cc:302] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5373e3522b3c47368865c73528ea496d, a5a15d9fc4f74892b1a39481c7214713; no voters:
I20260812 00:26:05.780870 9232 raft_consensus.cc:2781] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:26:05.781040 9232 raft_consensus.cc:482] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:26:05.781157 9232 raft_consensus.cc:3037] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:05.783563 9232 raft_consensus.cc:504] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a15d9fc4f74892b1a39481c7214713" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44045 } } peers { permanent_uuid: "5373e3522b3c47368865c73528ea496d" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45837 } } peers { permanent_uuid: "d440093732464f448fba5b90a2034647" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 37383 } }
I20260812 00:26:05.784261 9232 leader_election.cc:288] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [CANDIDATE]: Term 1 election: Requested vote from peers a5a15d9fc4f74892b1a39481c7214713 (127.18.163.194:44045), d440093732464f448fba5b90a2034647 (127.18.163.193:37383)
I20260812 00:26:05.784940 8856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad8e8a421f6a4e5581f8ffb04306becc" candidate_uuid: "5373e3522b3c47368865c73528ea496d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d440093732464f448fba5b90a2034647"
I20260812 00:26:05.784951 9006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad8e8a421f6a4e5581f8ffb04306becc" candidate_uuid: "5373e3522b3c47368865c73528ea496d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5a15d9fc4f74892b1a39481c7214713"
I20260812 00:26:05.785209 8856 raft_consensus.cc:3037] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:05.785220 9006 raft_consensus.cc:3037] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:05.787933 9006 raft_consensus.cc:2454] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5373e3522b3c47368865c73528ea496d in term 1.
I20260812 00:26:05.787952 8856 raft_consensus.cc:2454] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5373e3522b3c47368865c73528ea496d in term 1.
I20260812 00:26:05.788481 9082 leader_election.cc:302] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5373e3522b3c47368865c73528ea496d, a5a15d9fc4f74892b1a39481c7214713; no voters:
I20260812 00:26:05.788857 9232 raft_consensus.cc:2781] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:05.789326 9232 raft_consensus.cc:686] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [term 1 LEADER]: Becoming Leader. State: Replica: 5373e3522b3c47368865c73528ea496d, State: Running, Role: LEADER
I20260812 00:26:05.789952 9232 consensus_queue.cc:237] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a15d9fc4f74892b1a39481c7214713" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44045 } } peers { permanent_uuid: "5373e3522b3c47368865c73528ea496d" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45837 } } peers { permanent_uuid: "d440093732464f448fba5b90a2034647" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 37383 } }
I20260812 00:26:05.795426 8695 catalog_manager.cc:5495] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5373e3522b3c47368865c73528ea496d (127.18.163.195). New cstate: current_term: 1 leader_uuid: "5373e3522b3c47368865c73528ea496d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a15d9fc4f74892b1a39481c7214713" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5373e3522b3c47368865c73528ea496d" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 45837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d440093732464f448fba5b90a2034647" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 37383 } health_report { overall_health: UNKNOWN } } }
I20260812 00:26:05.909855 9243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:05.903363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59996 (local address 127.18.163.195:45837)
0812 00:26:05.903883 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:05.903888 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:05.904369 (+ 481us) server_negotiation.cc:407] Connection header received
0812 00:26:05.904569 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:05.904573 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:05.904677 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:05.904832 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:05.905271 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.906112 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.907528 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.907946 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.908069 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:05.908614 (+ 545us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:05.909215 (+ 601us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:05.909338 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:05.909448 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 00:26:05.909527 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":282,"threads_started":1}
I20260812 00:26:05.918562 8856 raft_consensus.cc:1261] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647 [term 1 FOLLOWER]: Refusing update from remote peer 5373e3522b3c47368865c73528ea496d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:26:05.918568 9006 raft_consensus.cc:1261] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713 [term 1 FOLLOWER]: Refusing update from remote peer 5373e3522b3c47368865c73528ea496d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:26:05.919662 9232 consensus_queue.cc:1035] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5a15d9fc4f74892b1a39481c7214713" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 44045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:26:05.920008 9236 consensus_queue.cc:1035] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d440093732464f448fba5b90a2034647" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 37383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:26:05.933310 9245 mvcc.cc:205] Tried to move back new op lower bound from 7317480922791243776 to 7317480922280333312. Current Snapshot: MvccSnapshot[applied={T|T < 7317480922791243776}]
I20260812 00:26:05.950628 8694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:26:05.950976 8694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:26:05.955384 8694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4b349274372f4df69a2f63988bba0c84: Sending DeleteTablet for 3 replicas of tablet ad8e8a421f6a4e5581f8ffb04306becc
I20260812 00:26:05.956938 9128 tablet_service.cc:1514] Processing DeleteTablet for tablet ad8e8a421f6a4e5581f8ffb04306becc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:26:05 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:59988
I20260812 00:26:05.956979 8831 tablet_service.cc:1514] Processing DeleteTablet for tablet ad8e8a421f6a4e5581f8ffb04306becc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:26:05 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:42436
I20260812 00:26:05.958124 9259 tablet_replica.cc:330] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647: stopping tablet replica
I20260812 00:26:05.958715 9259 raft_consensus.cc:2229] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:26:05.958779 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 8762
I20260812 00:26:05.958811 8981 tablet_service.cc:1514] Processing DeleteTablet for tablet ad8e8a421f6a4e5581f8ffb04306becc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:26:05 UTC) from {username='kudu', principal='kudu/127.18.163.254@KRBTEST.COM'} at 127.0.0.1:55226
I20260812 00:26:05.959504 9259 raft_consensus.cc:2258] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:26:05.960449 9258 tablet_replica.cc:330] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d: stopping tablet replica
I20260812 00:26:05.961030 9258 raft_consensus.cc:2229] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:26:05.961903 9258 raft_consensus.cc:2258] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:26:05.964278 9259 ts_tablet_manager.cc:1905] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:26:05.967037 9258 ts_tablet_manager.cc:1905] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:26:05.974426 9259 ts_tablet_manager.cc:1918] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:26:05.974821 9259 log.cc:1196] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/ad8e8a421f6a4e5581f8ffb04306becc
I20260812 00:26:05.975548 9259 ts_tablet_manager.cc:1939] T ad8e8a421f6a4e5581f8ffb04306becc P d440093732464f448fba5b90a2034647: Deleting consensus metadata
I20260812 00:26:05.977895 8678 catalog_manager.cc:4841] TS d440093732464f448fba5b90a2034647 (127.18.163.193:37383): tablet ad8e8a421f6a4e5581f8ffb04306becc (table test-table [id=56b533feea0f4b66b20235fc7b28f45b]) successfully deleted
I20260812 00:26:05.979310 9261 tablet_replica.cc:330] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713: stopping tablet replica
I20260812 00:26:05.979308 9258 ts_tablet_manager.cc:1918] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:26:05.979499 9258 log.cc:1196] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/ad8e8a421f6a4e5581f8ffb04306becc
I20260812 00:26:05.979836 9261 raft_consensus.cc:2229] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:26:05.980134 9258 ts_tablet_manager.cc:1939] T ad8e8a421f6a4e5581f8ffb04306becc P 5373e3522b3c47368865c73528ea496d: Deleting consensus metadata
I20260812 00:26:05.980381 9261 raft_consensus.cc:2258] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:26:05.982280 8678 catalog_manager.cc:4841] TS 5373e3522b3c47368865c73528ea496d (127.18.163.195:45837): tablet ad8e8a421f6a4e5581f8ffb04306becc (table test-table [id=56b533feea0f4b66b20235fc7b28f45b]) successfully deleted
Aug 12 00:26:05 dist-test-slave-njxd krb5kdc[8645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.193@KRBTEST.COM
I20260812 00:26:05.984414 9261 ts_tablet_manager.cc:1905] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:26:05.990325 9261 ts_tablet_manager.cc:1918] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:26:05.990531 9261 log.cc:1196] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/ad8e8a421f6a4e5581f8ffb04306becc
I20260812 00:26:05.991093 9261 ts_tablet_manager.cc:1939] T ad8e8a421f6a4e5581f8ffb04306becc P a5a15d9fc4f74892b1a39481c7214713: Deleting consensus metadata
I20260812 00:26:05.993039 8679 catalog_manager.cc:4841] TS a5a15d9fc4f74892b1a39481c7214713 (127.18.163.194:44045): tablet ad8e8a421f6a4e5581f8ffb04306becc (table test-table [id=56b533feea0f4b66b20235fc7b28f45b]) successfully deleted
I20260812 00:26:05.993626 9224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:05.960857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42446 (local address 127.18.163.193:37383)
0812 00:26:05.961057 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:05.961065 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:05.971091 (+ 10026us) server_negotiation.cc:407] Connection header received
0812 00:26:05.971694 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:05.971705 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:05.971806 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:05.971903 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:05.973880 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.975148 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.977126 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:05.977818 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:05.977949 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:05.985300 (+ 7351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:05.985324 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:05.985347 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:05.985408 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:05.989725 (+ 4317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:05.990913 (+ 1188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:05.990924 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:05.990928 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:05.991140 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:05.991650 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:05.991655 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:05.991659 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:05.992186 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:05.992533 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:05.992927 (+ 394us) server_negotiation.cc:299] Negotiation successful
0812 00:26:05.993194 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 00:26:05.994510 8898 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:06.089080 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 8762
I20260812 00:26:06.122488 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 8910
Aug 12 00:26:06 dist-test-slave-njxd krb5kdc[8645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.194@KRBTEST.COM
I20260812 00:26:06.141979 9221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:06.123568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55234 (local address 127.18.163.194:44045)
0812 00:26:06.123806 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:06.123814 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:06.123841 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:26:06.123918 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:06.123923 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:06.124016 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:06.124159 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:06.125525 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:06.126840 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:06.128331 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:06.129053 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:06.129206 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:06.134364 (+ 5158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:06.134391 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:06.134415 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:06.134475 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:06.138577 (+ 4102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:06.139500 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:06.139511 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:06.139515 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:06.139717 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:06.140156 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:06.140161 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:06.140165 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:06.140720 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:06.141086 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:06.141282 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 00:26:06.141544 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 00:26:06.142900 9052 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:06.245595 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 8910
W20260812 00:26:06.248870 9201 messenger.cc:188] Invalid argument: socket address is ambiguous: no data on pending connections for acceptor pool at 127.18.163.195:45837
I20260812 00:26:06.277988 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 9063
Aug 12 00:26:06 dist-test-slave-njxd krb5kdc[8645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.195@KRBTEST.COM
I20260812 00:26:06.297109 9243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:06.279025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60010 (local address 127.18.163.195:45837)
0812 00:26:06.279249 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:06.279256 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:06.279283 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:26:06.279371 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:06.279377 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:06.279486 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:06.279622 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:06.281058 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:06.282324 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:06.283709 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:06.284439 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:06.284611 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:06.289956 (+ 5345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:06.289979 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:06.290001 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:06.290068 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:06.293738 (+ 3670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:06.294644 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:06.294658 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:06.294661 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:06.294825 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:06.295283 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:06.295295 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:06.295297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:06.295735 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:06.296095 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:06.296430 (+ 335us) server_negotiation.cc:299] Negotiation successful
0812 00:26:06.296750 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260812 00:26:06.298058 9200 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:06.428906 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 9063
I20260812 00:26:06.452463 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 8660
I20260812 00:26:06.453783 8730 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:06.570102 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 8660
2026-08-12T00:26:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (5395 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T00:26:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:06Z Disabled control of system clock
I20260812 00:26:06.684825 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:42301
--webserver_interface=127.18.163.254
--webserver_port=0
--builtin_ntp_servers=127.18.163.212:40261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:42301
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:26:07.065732 9271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:07.066071 9271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:07.066246 9271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:07.077733 9271 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:07.077883 9271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:07.077970 9271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:07.078058 9271 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:07.078141 9271 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:07.088840 9271 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:40261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:42301
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:42301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:07.090416 9271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:07.092458 9271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:07.106205 9277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:07.106158 9278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:07.106108 9280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:07.107286 9271 server_base.cc:1034] running on GCE node
I20260812 00:26:07.108541 9271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:07.111092 9271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:07.112584 9271 hybrid_clock.cc:648] HybridClock initialized: now 1786494367112488 us; error 83 us; skew 500 ppm
I20260812 00:26:07.113320 9271 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:26:07.116425 9271 webserver.cc:460] Webserver started at http://127.18.163.254:41555/ using document root <none> and password file <none>
I20260812 00:26:07.117300 9271 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:07.117421 9271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:07.118023 9271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:07.121543 9271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "7f485ee5f3fb478f8222bfd763ea2ae5"
format_stamp: "Formatted at 2026-08-12 00:26:07 on dist-test-slave-njxd"
server_key: "2eae61c30f03cafa4d6ab4651d41c01e"
server_key_iv: "e2b5f51422be410f7a2a299d675b3474"
server_key_version: "encryptionkey@0"
I20260812 00:26:07.122640 9271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "7f485ee5f3fb478f8222bfd763ea2ae5"
format_stamp: "Formatted at 2026-08-12 00:26:07 on dist-test-slave-njxd"
server_key: "2eae61c30f03cafa4d6ab4651d41c01e"
server_key_iv: "e2b5f51422be410f7a2a299d675b3474"
server_key_version: "encryptionkey@0"
I20260812 00:26:07.129290 9271 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.002s
I20260812 00:26:07.133968 9287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:07.135741 9271 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:26:07.136011 9271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "7f485ee5f3fb478f8222bfd763ea2ae5"
format_stamp: "Formatted at 2026-08-12 00:26:07 on dist-test-slave-njxd"
server_key: "2eae61c30f03cafa4d6ab4651d41c01e"
server_key_iv: "e2b5f51422be410f7a2a299d675b3474"
server_key_version: "encryptionkey@0"
I20260812 00:26:07.136312 9271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:07.151866 9271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:07.152884 9271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:07.153239 9271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:07.174697 9271 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:42301
I20260812 00:26:07.174744 9343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:42301 every 8 connection(s)
I20260812 00:26:07.176324 9271 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:07.180701 9345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:07.185114 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 9271
I20260812 00:26:07.185286 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:07.185909 19087 external_mini_cluster.cc:1428] Setting key 04844be92529e0d067409e4f376bea34
I20260812 00:26:07.193257 9345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5: Bootstrap starting.
I20260812 00:26:07.197528 9345 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:07.199071 9345 log.cc:824] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:07.202752 9348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:07.188065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40704 (local address 127.18.163.254:42301)
0812 00:26:07.189214 (+ 1149us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:07.189226 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:07.189282 (+ 56us) server_negotiation.cc:407] Connection header received
0812 00:26:07.191400 (+ 2118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:07.191430 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:07.192016 (+ 586us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:07.192431 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:07.193284 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:07.194889 (+ 1605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:07.196997 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:07.198005 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:07.198199 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:07.199601 (+ 1402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:07.199609 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:07.199626 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:07.200639 (+ 1013us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:07.200762 (+ 123us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:07.200796 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:07.200908 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:07.201215 (+ 307us) server_negotiation.cc:299] Negotiation successful
0812 00:26:07.201644 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":414,"threads_started":1}
I20260812 00:26:07.202992 9345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5: No bootstrap required, opened a new log
I20260812 00:26:07.211017 9345 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f485ee5f3fb478f8222bfd763ea2ae5" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 42301 } }
I20260812 00:26:07.211439 9345 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:07.211580 9345 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f485ee5f3fb478f8222bfd763ea2ae5, State: Initialized, Role: FOLLOWER
I20260812 00:26:07.212247 9345 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f485ee5f3fb478f8222bfd763ea2ae5" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 42301 } }
I20260812 00:26:07.212522 9345 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:07.212685 9345 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:07.212895 9345 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:07.215371 9345 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f485ee5f3fb478f8222bfd763ea2ae5" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 42301 } }
I20260812 00:26:07.215957 9345 leader_election.cc:302] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f485ee5f3fb478f8222bfd763ea2ae5; no voters:
I20260812 00:26:07.216609 9345 leader_election.cc:288] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:07.216811 9350 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:07.218142 9350 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [term 1 LEADER]: Becoming Leader. State: Replica: 7f485ee5f3fb478f8222bfd763ea2ae5, State: Running, Role: LEADER
I20260812 00:26:07.218897 9350 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f485ee5f3fb478f8222bfd763ea2ae5" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 42301 } }
I20260812 00:26:07.219257 9345 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:07.221877 9354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f485ee5f3fb478f8222bfd763ea2ae5. Latest consensus state: current_term: 1 leader_uuid: "7f485ee5f3fb478f8222bfd763ea2ae5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f485ee5f3fb478f8222bfd763ea2ae5" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 42301 } } }
I20260812 00:26:07.222281 9354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:07.222900 9352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f485ee5f3fb478f8222bfd763ea2ae5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f485ee5f3fb478f8222bfd763ea2ae5" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 42301 } } }
I20260812 00:26:07.223225 9352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:07.223304 9359 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:07.230191 9359 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:07.240911 9359 catalog_manager.cc:1347] Generated new cluster ID: 2bcfe702874f469595f0ef624f8a0f2a
I20260812 00:26:07.241063 9359 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:07.253907 9359 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:07.255364 9359 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:07.265107 9359 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5: Generated new TSK 0
I20260812 00:26:07.266157 9359 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:07.278350 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.193:0
--local_ip_for_outbound_sockets=127.18.163.193
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:42301
--builtin_ntp_servers=127.18.163.212:40261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:26:07.691593 9373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:07.691923 9373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:07.692102 9373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:07.699843 9373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:07.699978 9373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:07.700181 9373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.193
I20260812 00:26:07.710274 9373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:40261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.163.193
--webserver_port=0
--tserver_master_addrs=127.18.163.254:42301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.193
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:07.711746 9373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:07.713829 9373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:07.730762 9380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:07.730700 9381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:07.730667 9383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:07.732167 9373 server_base.cc:1034] running on GCE node
I20260812 00:26:07.732833 9373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:07.734016 9373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:07.735277 9373 hybrid_clock.cc:648] HybridClock initialized: now 1786494367735224 us; error 49 us; skew 500 ppm
I20260812 00:26:07.735647 9373 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:26:07.738306 9373 webserver.cc:460] Webserver started at http://127.18.163.193:44997/ using document root <none> and password file <none>
I20260812 00:26:07.739109 9373 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:07.739256 9373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:07.739671 9373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:07.743034 9373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/data/instance:
uuid: "7cbb581da6304722987255c145fd4d49"
format_stamp: "Formatted at 2026-08-12 00:26:07 on dist-test-slave-njxd"
server_key: "f371aaebc97d0745adec1a6f5e2745d9"
server_key_iv: "4c72a3553b33d38a4d7051e0cf61ef24"
server_key_version: "encryptionkey@0"
I20260812 00:26:07.743950 9373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance:
uuid: "7cbb581da6304722987255c145fd4d49"
format_stamp: "Formatted at 2026-08-12 00:26:07 on dist-test-slave-njxd"
server_key: "f371aaebc97d0745adec1a6f5e2745d9"
server_key_iv: "4c72a3553b33d38a4d7051e0cf61ef24"
server_key_version: "encryptionkey@0"
I20260812 00:26:07.749684 9373 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260812 00:26:07.753666 9390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:07.755225 9373 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:26:07.755432 9373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/wal
uuid: "7cbb581da6304722987255c145fd4d49"
format_stamp: "Formatted at 2026-08-12 00:26:07 on dist-test-slave-njxd"
server_key: "f371aaebc97d0745adec1a6f5e2745d9"
server_key_iv: "4c72a3553b33d38a4d7051e0cf61ef24"
server_key_version: "encryptionkey@0"
I20260812 00:26:07.755684 9373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:07.774376 9373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:07.775374 9373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:07.775729 9373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:07.776857 9373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:26:07.778644 9373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:26:07.778741 9373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:07.778915 9373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:26:07.779016 9373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:07.815526 9373 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.193:33269
I20260812 00:26:07.815578 9516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.193:33269 every 8 connection(s)
I20260812 00:26:07.816999 9373 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/data/info.pb
I20260812 00:26:07.825368 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 9373
I20260812 00:26:07.825609 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/wal/instance
I20260812 00:26:07.826138 19087 external_mini_cluster.cc:1428] Setting key d95b80c1e3572d6f87c63045740d6ff3
I20260812 00:26:07.829602 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.194:0
--local_ip_for_outbound_sockets=127.18.163.194
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:42301
--builtin_ntp_servers=127.18.163.212:40261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:26:07.833180 9519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:07.820043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.193:47839 (local address 127.18.163.254:42301)
0812 00:26:07.820828 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:07.820838 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:07.822456 (+ 1618us) server_negotiation.cc:407] Connection header received
0812 00:26:07.824552 (+ 2096us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:07.824558 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:07.824668 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:07.824801 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:07.826388 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:07.827358 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:07.829769 (+ 2411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:07.830264 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:07.830379 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:07.832337 (+ 1958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:07.832342 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:07.832346 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:07.832367 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:07.832411 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:07.832424 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:07.832495 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:07.832805 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 00:26:07.832899 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":388,"threads_started":1}
I20260812 00:26:07.834928 9520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:07.820879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:42301 (local address 127.18.163.193:47839)
0812 00:26:07.822235 (+ 1356us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:07.822302 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:07.824212 (+ 1910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:07.825137 (+ 925us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:07.825147 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:07.825256 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:07.826184 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:07.826212 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:07.827539 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:07.827544 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:07.829558 (+ 2014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:07.829608 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:07.830555 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:07.830566 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:07.830958 (+ 392us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:07.831877 (+ 919us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:26:07.831883 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:07.831949 (+ 66us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:26:07.832080 (+ 131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:07.832527 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:07.832541 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:07.832552 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:26:07.832755 (+ 203us) client_negotiation.cc:240] Negotiation successful
0812 00:26:07.833264 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":344,"threads_started":1}
I20260812 00:26:07.836654 9517 heartbeater.cc:347] Connected to a master server at 127.18.163.254:42301
I20260812 00:26:07.837006 9517 heartbeater.cc:464] Registering TS with master...
I20260812 00:26:07.837949 9517 heartbeater.cc:511] Master 127.18.163.254:42301 requested a full tablet report, sending...
I20260812 00:26:07.840299 9305 ts_manager.cc:194] Registered new tserver with Master: 7cbb581da6304722987255c145fd4d49 (127.18.163.193:33269)
I20260812 00:26:07.842182 9305 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.163.193:47839
W20260812 00:26:08.211561 9521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:08.211889 9521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:08.212034 9521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:08.219748 9521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:08.219873 9521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:08.220084 9521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.194
I20260812 00:26:08.229774 9521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:40261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.163.194
--webserver_port=0
--tserver_master_addrs=127.18.163.254:42301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.194
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:08.231287 9521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:08.233330 9521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:08.247998 9527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:08.248025 9528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:08.247927 9530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:08.248907 9521 server_base.cc:1034] running on GCE node
I20260812 00:26:08.249708 9521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:08.250811 9521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:08.252068 9521 hybrid_clock.cc:648] HybridClock initialized: now 1786494368252008 us; error 53 us; skew 500 ppm
I20260812 00:26:08.252425 9521 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:26:08.258599 9521 webserver.cc:460] Webserver started at http://127.18.163.194:32993/ using document root <none> and password file <none>
I20260812 00:26:08.259442 9521 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:08.259605 9521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:08.259958 9521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:08.263518 9521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/data/instance:
uuid: "5c354c9313ff4e90aa648f5c01ff27d5"
format_stamp: "Formatted at 2026-08-12 00:26:08 on dist-test-slave-njxd"
server_key: "61a63cfcae17a37f4aab0bb1c49e93f2"
server_key_iv: "f2cacf23557464a14fca418bd775d16d"
server_key_version: "encryptionkey@0"
I20260812 00:26:08.264493 9521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance:
uuid: "5c354c9313ff4e90aa648f5c01ff27d5"
format_stamp: "Formatted at 2026-08-12 00:26:08 on dist-test-slave-njxd"
server_key: "61a63cfcae17a37f4aab0bb1c49e93f2"
server_key_iv: "f2cacf23557464a14fca418bd775d16d"
server_key_version: "encryptionkey@0"
I20260812 00:26:08.270846 9521 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260812 00:26:08.275218 9536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:08.276788 9521 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260812 00:26:08.277016 9521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/wal
uuid: "5c354c9313ff4e90aa648f5c01ff27d5"
format_stamp: "Formatted at 2026-08-12 00:26:08 on dist-test-slave-njxd"
server_key: "61a63cfcae17a37f4aab0bb1c49e93f2"
server_key_iv: "f2cacf23557464a14fca418bd775d16d"
server_key_version: "encryptionkey@0"
I20260812 00:26:08.277300 9521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:08.303635 9521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:08.304606 9521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:08.304946 9521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:08.306041 9521 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:26:08.307678 9521 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:26:08.307813 9521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:08.307941 9521 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:26:08.308034 9521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:08.344558 9521 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.194:40009
I20260812 00:26:08.344622 9660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.194:40009 every 8 connection(s)
I20260812 00:26:08.346091 9521 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/data/info.pb
I20260812 00:26:08.350149 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 9521
I20260812 00:26:08.350366 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/wal/instance
I20260812 00:26:08.350966 19087 external_mini_cluster.cc:1428] Setting key 4b8c16d6843d89556081219beeb4b9d8
I20260812 00:26:08.354270 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.163.195:0
--local_ip_for_outbound_sockets=127.18.163.195
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:42301
--builtin_ntp_servers=127.18.163.212:40261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:26:08.361311 9663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:08.348792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.194:47807 (local address 127.18.163.254:42301)
0812 00:26:08.349265 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:08.349270 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:08.350790 (+ 1520us) server_negotiation.cc:407] Connection header received
0812 00:26:08.353208 (+ 2418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:08.353239 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:08.353328 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:08.353439 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:08.354753 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.356040 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.357800 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.358555 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.358711 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:08.360207 (+ 1496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:08.360217 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:08.360224 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:08.360253 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:08.360310 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:08.360329 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:08.360429 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:08.360714 (+ 285us) server_negotiation.cc:299] Negotiation successful
0812 00:26:08.360836 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":253,"threads_started":1}
I20260812 00:26:08.362435 9664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:08.349434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:42301 (local address 127.18.163.194:47807)
0812 00:26:08.350607 (+ 1173us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:08.350651 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:08.352860 (+ 2209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:08.353718 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:08.353727 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:08.353833 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:08.354558 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:08.354580 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.356227 (+ 1647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.356231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:08.357564 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:08.357634 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.358802 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.358808 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:08.359027 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:08.359806 (+ 779us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:26:08.359808 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:08.359854 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:26:08.359950 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:08.360432 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:08.360441 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:08.360447 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:26:08.360657 (+ 210us) client_negotiation.cc:240] Negotiation successful
0812 00:26:08.361055 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":347,"threads_started":1}
I20260812 00:26:08.364049 9661 heartbeater.cc:347] Connected to a master server at 127.18.163.254:42301
I20260812 00:26:08.364398 9661 heartbeater.cc:464] Registering TS with master...
I20260812 00:26:08.365203 9661 heartbeater.cc:511] Master 127.18.163.254:42301 requested a full tablet report, sending...
I20260812 00:26:08.366866 9305 ts_manager.cc:194] Registered new tserver with Master: 5c354c9313ff4e90aa648f5c01ff27d5 (127.18.163.194:40009)
I20260812 00:26:08.367693 9305 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.163.194:47807
W20260812 00:26:08.723654 9665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:08.723979 9665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:08.724164 9665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:08.731946 9665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:08.732075 9665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:08.732264 9665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.163.195
I20260812 00:26:08.742019 9665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:40261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.163.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.163.195
--webserver_port=0
--tserver_master_addrs=127.18.163.254:42301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.163.195
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:08.743414 9665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:08.745330 9665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:08.759893 9671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:08.759858 9674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:08.759971 9672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:08.760672 9665 server_base.cc:1034] running on GCE node
I20260812 00:26:08.761961 9665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:08.763258 9665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:08.764508 9665 hybrid_clock.cc:648] HybridClock initialized: now 1786494368764399 us; error 107 us; skew 500 ppm
I20260812 00:26:08.764897 9665 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:26:08.767464 9665 webserver.cc:460] Webserver started at http://127.18.163.195:32853/ using document root <none> and password file <none>
I20260812 00:26:08.768246 9665 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:08.768374 9665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:08.768736 9665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:08.771963 9665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/data/instance:
uuid: "8d2e305ba1044c1e95348c2cfcd654dd"
format_stamp: "Formatted at 2026-08-12 00:26:08 on dist-test-slave-njxd"
server_key: "75f203f3629ee21139263d6cc9c9efe1"
server_key_iv: "fe037f3236abad88bdb4d7a0c32de8cf"
server_key_version: "encryptionkey@0"
I20260812 00:26:08.772836 9665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance:
uuid: "8d2e305ba1044c1e95348c2cfcd654dd"
format_stamp: "Formatted at 2026-08-12 00:26:08 on dist-test-slave-njxd"
server_key: "75f203f3629ee21139263d6cc9c9efe1"
server_key_iv: "fe037f3236abad88bdb4d7a0c32de8cf"
server_key_version: "encryptionkey@0"
I20260812 00:26:08.778630 9665 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260812 00:26:08.782519 9681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:08.784004 9665 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:26:08.784190 9665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/wal
uuid: "8d2e305ba1044c1e95348c2cfcd654dd"
format_stamp: "Formatted at 2026-08-12 00:26:08 on dist-test-slave-njxd"
server_key: "75f203f3629ee21139263d6cc9c9efe1"
server_key_iv: "fe037f3236abad88bdb4d7a0c32de8cf"
server_key_version: "encryptionkey@0"
I20260812 00:26:08.784415 9665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:08.808262 9665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:08.809204 9665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:08.809546 9665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:08.810719 9665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:26:08.812407 9665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:26:08.812528 9665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:08.812676 9665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:26:08.812772 9665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:08.845631 9517 heartbeater.cc:503] Master 127.18.163.254:42301 was elected leader, sending a full tablet report...
I20260812 00:26:08.850358 9665 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.195:41171
I20260812 00:26:08.850450 9804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.195:41171 every 8 connection(s)
I20260812 00:26:08.851795 9665 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/data/info.pb
I20260812 00:26:08.858855 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 9665
I20260812 00:26:08.859067 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/wal/instance
I20260812 00:26:08.859642 19087 external_mini_cluster.cc:1428] Setting key 5fd829d948b4c83b130c1746e3e3c5cb
I20260812 00:26:08.866497 9663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:08.854630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:47683 (local address 127.18.163.254:42301)
0812 00:26:08.854855 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:08.854862 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:08.856443 (+ 1581us) server_negotiation.cc:407] Connection header received
0812 00:26:08.858409 (+ 1966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:08.858414 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:08.858508 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:08.858656 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:08.860278 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.861271 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.863523 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.864004 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.864155 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:08.865616 (+ 1461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:08.865624 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:08.865629 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:08.865654 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:08.865698 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:08.865713 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:08.865814 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:08.866050 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 00:26:08.866164 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 00:26:08.867624 9807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:08.855265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:42301 (local address 127.18.163.195:47683)
0812 00:26:08.856253 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:08.856300 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:08.858108 (+ 1808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:08.858950 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:08.858964 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:08.859132 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:08.860017 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:08.860046 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.861464 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.861468 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:08.863366 (+ 1898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:08.863381 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.864266 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.864274 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:08.864521 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:08.865217 (+ 696us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:26:08.865219 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:08.865264 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:26:08.865353 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:08.865812 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:08.865825 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:08.865836 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:26:08.866040 (+ 204us) client_negotiation.cc:240] Negotiation successful
0812 00:26:08.866497 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":311,"threads_started":1}
I20260812 00:26:08.869233 9805 heartbeater.cc:347] Connected to a master server at 127.18.163.254:42301
I20260812 00:26:08.869518 9805 heartbeater.cc:464] Registering TS with master...
I20260812 00:26:08.870335 9805 heartbeater.cc:511] Master 127.18.163.254:42301 requested a full tablet report, sending...
I20260812 00:26:08.871867 9305 ts_manager.cc:194] Registered new tserver with Master: 8d2e305ba1044c1e95348c2cfcd654dd (127.18.163.195:41171)
I20260812 00:26:08.872740 9305 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.163.195:47683
I20260812 00:26:08.875586 19087 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:26:08.885782 9663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:08.879846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40716 (local address 127.18.163.254:42301)
0812 00:26:08.880109 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:08.880119 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:08.880519 (+ 400us) server_negotiation.cc:407] Connection header received
0812 00:26:08.880606 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:08.880610 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:08.880680 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:08.880785 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:08.881224 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.882108 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.883530 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.883931 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.884028 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:08.885023 (+ 995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:08.885028 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:08.885031 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:08.885051 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:08.885084 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:08.885096 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:08.885168 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:08.885294 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 00:26:08.885374 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260812 00:26:08.890009 9305 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40716:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:26:08.897120 9305 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:26:08.920311 9819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:08.910103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:40009 (local address 127.0.0.1:34492)
0812 00:26:08.911015 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:08.911051 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:08.911272 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:08.912083 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:08.912092 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:08.912131 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:26:08.912623 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:08.912638 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.914668 (+ 2030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.914674 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:08.917070 (+ 2396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:08.917086 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.919320 (+ 2234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.919327 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:08.919545 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:08.919602 (+ 57us) client_negotiation.cc:769] Sending connection context
0812 00:26:08.919742 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 00:26:08.919926 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":457,"threads_started":1}
I20260812 00:26:08.920487 9820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:08.910261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34492 (local address 127.18.163.194:40009)
0812 00:26:08.910951 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:08.910962 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:08.911184 (+ 222us) server_negotiation.cc:407] Connection header received
0812 00:26:08.911548 (+ 364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:08.911556 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:08.911817 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:08.912011 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:26:08.912862 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.914476 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.917281 (+ 2805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.918756 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.918931 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:08.919169 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:08.919841 (+ 672us) server_negotiation.cc:299] Negotiation successful
0812 00:26:08.920049 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":400,"threads_started":1}
I20260812 00:26:08.921535 9821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:08.911462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:33269 (local address 127.0.0.1:52598)
0812 00:26:08.912766 (+ 1304us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:08.912785 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:08.912887 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:08.914053 (+ 1166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:08.914059 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:08.914088 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:26:08.914497 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:08.914510 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.916752 (+ 2242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.916761 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:08.918880 (+ 2119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:08.918894 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.920776 (+ 1882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.920783 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:08.920952 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:08.920985 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 00:26:08.921054 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 00:26:08.921183 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1156,"mutex_wait_us":3,"thread_start_us":950,"threads_started":1}
I20260812 00:26:08.922602 9822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:08.911856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52598 (local address 127.18.163.193:33269)
0812 00:26:08.913445 (+ 1589us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:08.913453 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:08.913485 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:26:08.913602 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:08.913610 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:08.913830 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:08.914724 (+ 894us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:26:08.915009 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.916586 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.919139 (+ 2553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.920508 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.921469 (+ 961us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:08.921937 (+ 468us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:08.922015 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 00:26:08.922220 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1394,"thread_start_us":1233,"threads_started":1}
I20260812 00:26:08.923086 9823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:08.913163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35686 (local address 127.18.163.195:41171)
0812 00:26:08.913799 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:08.913810 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:08.914686 (+ 876us) server_negotiation.cc:407] Connection header received
0812 00:26:08.915014 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:08.915022 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:08.915274 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:08.915441 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:26:08.916194 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.917653 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.920378 (+ 2725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.921947 (+ 1569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.922161 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:08.922359 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:08.922563 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 00:26:08.922758 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":439,"threads_started":1}
I20260812 00:26:08.924635 9825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:08.913451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.195:41171 (local address 127.0.0.1:35686)
0812 00:26:08.914562 (+ 1111us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:08.914582 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:08.914801 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:08.915594 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:08.915599 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:08.915626 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:26:08.915991 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:08.915999 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.917807 (+ 1808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.917813 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:08.920070 (+ 2257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:08.920154 (+ 84us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:08.922159 (+ 2005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:08.922166 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:08.922334 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:08.922373 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 00:26:08.923349 (+ 976us) client_negotiation.cc:240] Negotiation successful
0812 00:26:08.923489 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":695,"thread_start_us":541,"threads_started":1}
I20260812 00:26:08.925001 9590 tablet_service.cc:1467] Processing CreateTablet for tablet 84298fe6725e47489331f182785bb16c (DEFAULT_TABLE table=test-table [id=77f4af77d9a94099b997a25170bae6fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:26:08.926644 9590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84298fe6725e47489331f182785bb16c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:08.926694 9441 tablet_service.cc:1467] Processing CreateTablet for tablet 84298fe6725e47489331f182785bb16c (DEFAULT_TABLE table=test-table [id=77f4af77d9a94099b997a25170bae6fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:26:08.928210 9441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84298fe6725e47489331f182785bb16c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:08.928224 9733 tablet_service.cc:1467] Processing CreateTablet for tablet 84298fe6725e47489331f182785bb16c (DEFAULT_TABLE table=test-table [id=77f4af77d9a94099b997a25170bae6fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:26:08.929487 9733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84298fe6725e47489331f182785bb16c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:08.943086 9826 tablet_bootstrap.cc:492] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd: Bootstrap starting.
I20260812 00:26:08.943357 9827 tablet_bootstrap.cc:492] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5: Bootstrap starting.
I20260812 00:26:08.946424 9828 tablet_bootstrap.cc:492] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49: Bootstrap starting.
I20260812 00:26:08.947352 9826 tablet_bootstrap.cc:654] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:08.947352 9827 tablet_bootstrap.cc:654] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:08.948734 9826 log.cc:824] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:08.948729 9827 log.cc:824] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:08.949857 9828 tablet_bootstrap.cc:654] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:08.951325 9828 log.cc:824] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:08.952586 9826 tablet_bootstrap.cc:492] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd: No bootstrap required, opened a new log
I20260812 00:26:08.952553 9827 tablet_bootstrap.cc:492] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5: No bootstrap required, opened a new log
I20260812 00:26:08.952932 9827 ts_tablet_manager.cc:1397] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260812 00:26:08.952977 9826 ts_tablet_manager.cc:1397] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260812 00:26:08.955468 9828 tablet_bootstrap.cc:492] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49: No bootstrap required, opened a new log
I20260812 00:26:08.955798 9828 ts_tablet_manager.cc:1397] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.006s
I20260812 00:26:08.960922 9827 raft_consensus.cc:348] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c354c9313ff4e90aa648f5c01ff27d5" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 40009 } } peers { permanent_uuid: "7cbb581da6304722987255c145fd4d49" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33269 } } peers { permanent_uuid: "8d2e305ba1044c1e95348c2cfcd654dd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 41171 } }
I20260812 00:26:08.961499 9827 raft_consensus.cc:374] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:08.961640 9827 raft_consensus.cc:729] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c354c9313ff4e90aa648f5c01ff27d5, State: Initialized, Role: FOLLOWER
I20260812 00:26:08.962493 9827 consensus_queue.cc:260] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c354c9313ff4e90aa648f5c01ff27d5" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 40009 } } peers { permanent_uuid: "7cbb581da6304722987255c145fd4d49" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33269 } } peers { permanent_uuid: "8d2e305ba1044c1e95348c2cfcd654dd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 41171 } }
I20260812 00:26:08.963970 9661 heartbeater.cc:503] Master 127.18.163.254:42301 was elected leader, sending a full tablet report...
I20260812 00:26:08.964212 9826 raft_consensus.cc:348] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c354c9313ff4e90aa648f5c01ff27d5" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 40009 } } peers { permanent_uuid: "7cbb581da6304722987255c145fd4d49" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33269 } } peers { permanent_uuid: "8d2e305ba1044c1e95348c2cfcd654dd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 41171 } }
I20260812 00:26:08.964602 9827 ts_tablet_manager.cc:1428] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260812 00:26:08.964699 9826 raft_consensus.cc:374] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:08.964813 9826 raft_consensus.cc:729] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d2e305ba1044c1e95348c2cfcd654dd, State: Initialized, Role: FOLLOWER
I20260812 00:26:08.965556 9826 consensus_queue.cc:260] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c354c9313ff4e90aa648f5c01ff27d5" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 40009 } } peers { permanent_uuid: "7cbb581da6304722987255c145fd4d49" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33269 } } peers { permanent_uuid: "8d2e305ba1044c1e95348c2cfcd654dd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 41171 } }
I20260812 00:26:08.966823 9805 heartbeater.cc:503] Master 127.18.163.254:42301 was elected leader, sending a full tablet report...
I20260812 00:26:08.967535 9826 ts_tablet_manager.cc:1428] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd: Time spent starting tablet: real 0.014s user 0.008s sys 0.005s
I20260812 00:26:08.968751 9828 raft_consensus.cc:348] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c354c9313ff4e90aa648f5c01ff27d5" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 40009 } } peers { permanent_uuid: "7cbb581da6304722987255c145fd4d49" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33269 } } peers { permanent_uuid: "8d2e305ba1044c1e95348c2cfcd654dd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 41171 } }
I20260812 00:26:08.969195 9828 raft_consensus.cc:374] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:08.969321 9828 raft_consensus.cc:729] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cbb581da6304722987255c145fd4d49, State: Initialized, Role: FOLLOWER
I20260812 00:26:08.970039 9828 consensus_queue.cc:260] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c354c9313ff4e90aa648f5c01ff27d5" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 40009 } } peers { permanent_uuid: "7cbb581da6304722987255c145fd4d49" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33269 } } peers { permanent_uuid: "8d2e305ba1044c1e95348c2cfcd654dd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 41171 } }
I20260812 00:26:08.971995 9828 ts_tablet_manager.cc:1428] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49: Time spent starting tablet: real 0.016s user 0.013s sys 0.002s
W20260812 00:26:09.070025 9518 tablet.cc:2369] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:26:09.098337 9662 tablet.cc:2369] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:26:09.103572 9806 tablet.cc:2369] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:26:09.150344 9833 raft_consensus.cc:482] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:26:09.150736 9833 raft_consensus.cc:504] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c354c9313ff4e90aa648f5c01ff27d5" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 40009 } } peers { permanent_uuid: "7cbb581da6304722987255c145fd4d49" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33269 } } peers { permanent_uuid: "8d2e305ba1044c1e95348c2cfcd654dd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 41171 } }
I20260812 00:26:09.152508 9833 leader_election.cc:288] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c354c9313ff4e90aa648f5c01ff27d5 (127.18.163.194:40009), 7cbb581da6304722987255c145fd4d49 (127.18.163.193:33269)
I20260812 00:26:09.159834 9820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:09.152943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:56975 (local address 127.18.163.194:40009)
0812 00:26:09.153211 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:09.153219 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:09.153245 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:26:09.153471 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:09.153480 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:09.153609 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:09.153714 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:26:09.154445 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:09.155517 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:09.157627 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:09.158838 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:09.158962 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:09.159013 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:09.159507 (+ 494us) server_negotiation.cc:299] Negotiation successful
0812 00:26:09.159623 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260812 00:26:09.159868 9807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:09.152917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.194:40009 (local address 127.18.163.195:56975)
0812 00:26:09.153154 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:09.153173 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:09.153302 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:09.153959 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:09.153965 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:09.153995 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:26:09.154258 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:09.154278 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:09.155665 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:09.155673 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:09.157398 (+ 1725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:09.157415 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:09.158998 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:09.159005 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:09.159226 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:09.159264 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:26:09.159366 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 00:26:09.159523 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70,"mutex_wait_us":1}
I20260812 00:26:09.161005 9822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:09.153727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.163.195:52339 (local address 127.18.163.193:33269)
0812 00:26:09.153950 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:09.153958 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:09.154482 (+ 524us) server_negotiation.cc:407] Connection header received
0812 00:26:09.154672 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:09.154676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:09.154737 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:09.154808 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:26:09.155434 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:09.156495 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:09.158703 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:09.159971 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:09.160162 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:09.160239 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:09.160553 (+ 314us) server_negotiation.cc:299] Negotiation successful
0812 00:26:09.160716 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 00:26:09.161041 9835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:09.153384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.193:33269 (local address 127.18.163.195:52339)
0812 00:26:09.154339 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:09.154380 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:09.154513 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:09.154858 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:09.154863 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:09.154895 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:26:09.155272 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:09.155284 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:09.156664 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:09.156667 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:09.158469 (+ 1802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:09.158486 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:09.160223 (+ 1737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:09.160229 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:09.160375 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:09.160399 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 00:26:09.160476 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:26:09.160690 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":852,"thread_start_us":663,"threads_started":1}
I20260812 00:26:09.161134 9610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84298fe6725e47489331f182785bb16c" candidate_uuid: "8d2e305ba1044c1e95348c2cfcd654dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c354c9313ff4e90aa648f5c01ff27d5" is_pre_election: true
I20260812 00:26:09.161883 9610 raft_consensus.cc:2454] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2e305ba1044c1e95348c2cfcd654dd in term 0.
I20260812 00:26:09.162319 9466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84298fe6725e47489331f182785bb16c" candidate_uuid: "8d2e305ba1044c1e95348c2cfcd654dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cbb581da6304722987255c145fd4d49" is_pre_election: true
I20260812 00:26:09.162659 9682 leader_election.cc:302] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c354c9313ff4e90aa648f5c01ff27d5, 8d2e305ba1044c1e95348c2cfcd654dd; no voters:
I20260812 00:26:09.162930 9466 raft_consensus.cc:2454] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2e305ba1044c1e95348c2cfcd654dd in term 0.
I20260812 00:26:09.163077 9833 raft_consensus.cc:2781] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:26:09.163280 9833 raft_consensus.cc:482] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:26:09.163393 9833 raft_consensus.cc:3037] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:09.165776 9833 raft_consensus.cc:504] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c354c9313ff4e90aa648f5c01ff27d5" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 40009 } } peers { permanent_uuid: "7cbb581da6304722987255c145fd4d49" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33269 } } peers { permanent_uuid: "8d2e305ba1044c1e95348c2cfcd654dd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 41171 } }
I20260812 00:26:09.166379 9833 leader_election.cc:288] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [CANDIDATE]: Term 1 election: Requested vote from peers 5c354c9313ff4e90aa648f5c01ff27d5 (127.18.163.194:40009), 7cbb581da6304722987255c145fd4d49 (127.18.163.193:33269)
I20260812 00:26:09.166985 9610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84298fe6725e47489331f182785bb16c" candidate_uuid: "8d2e305ba1044c1e95348c2cfcd654dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c354c9313ff4e90aa648f5c01ff27d5"
I20260812 00:26:09.167021 9466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84298fe6725e47489331f182785bb16c" candidate_uuid: "8d2e305ba1044c1e95348c2cfcd654dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cbb581da6304722987255c145fd4d49"
I20260812 00:26:09.167213 9610 raft_consensus.cc:3037] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:09.167227 9466 raft_consensus.cc:3037] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:09.169502 9466 raft_consensus.cc:2454] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2e305ba1044c1e95348c2cfcd654dd in term 1.
I20260812 00:26:09.169540 9610 raft_consensus.cc:2454] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2e305ba1044c1e95348c2cfcd654dd in term 1.
I20260812 00:26:09.170140 9682 leader_election.cc:302] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c354c9313ff4e90aa648f5c01ff27d5, 8d2e305ba1044c1e95348c2cfcd654dd; no voters:
I20260812 00:26:09.170481 9833 raft_consensus.cc:2781] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:09.170974 9833 raft_consensus.cc:686] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [term 1 LEADER]: Becoming Leader. State: Replica: 8d2e305ba1044c1e95348c2cfcd654dd, State: Running, Role: LEADER
I20260812 00:26:09.171599 9833 consensus_queue.cc:237] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c354c9313ff4e90aa648f5c01ff27d5" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 40009 } } peers { permanent_uuid: "7cbb581da6304722987255c145fd4d49" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33269 } } peers { permanent_uuid: "8d2e305ba1044c1e95348c2cfcd654dd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 41171 } }
I20260812 00:26:09.176487 9305 catalog_manager.cc:5495] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d2e305ba1044c1e95348c2cfcd654dd (127.18.163.195). New cstate: current_term: 1 leader_uuid: "8d2e305ba1044c1e95348c2cfcd654dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c354c9313ff4e90aa648f5c01ff27d5" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 40009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7cbb581da6304722987255c145fd4d49" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2e305ba1044c1e95348c2cfcd654dd" member_type: VOTER last_known_addr { host: "127.18.163.195" port: 41171 } health_report { overall_health: HEALTHY } } }
I20260812 00:26:09.222585 9823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:09.216316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35696 (local address 127.18.163.195:41171)
0812 00:26:09.216583 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:09.216588 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:09.216618 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:26:09.216863 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:09.216867 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:09.216985 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:09.217157 (+ 172us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:09.217666 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:09.218503 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:09.220212 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:09.220658 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:09.220760 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:09.221307 (+ 547us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:09.221943 (+ 636us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:09.222062 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:09.222194 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 00:26:09.222273 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260812 00:26:09.231732 9466 raft_consensus.cc:1261] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49 [term 1 FOLLOWER]: Refusing update from remote peer 8d2e305ba1044c1e95348c2cfcd654dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:26:09.231724 9610 raft_consensus.cc:1261] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5 [term 1 FOLLOWER]: Refusing update from remote peer 8d2e305ba1044c1e95348c2cfcd654dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:26:09.232844 9836 consensus_queue.cc:1035] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cbb581da6304722987255c145fd4d49" member_type: VOTER last_known_addr { host: "127.18.163.193" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:26:09.233299 9833 consensus_queue.cc:1035] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c354c9313ff4e90aa648f5c01ff27d5" member_type: VOTER last_known_addr { host: "127.18.163.194" port: 40009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:26:09.259958 9304 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:26:09.260277 9304 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:26:09.264860 9304 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7f485ee5f3fb478f8222bfd763ea2ae5: Sending DeleteTablet for 3 replicas of tablet 84298fe6725e47489331f182785bb16c
I20260812 00:26:09.266201 9590 tablet_service.cc:1514] Processing DeleteTablet for tablet 84298fe6725e47489331f182785bb16c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:26:09 UTC) from {username='slave'} at 127.0.0.1:34492
I20260812 00:26:09.266366 9733 tablet_service.cc:1514] Processing DeleteTablet for tablet 84298fe6725e47489331f182785bb16c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:26:09 UTC) from {username='slave'} at 127.0.0.1:35686
I20260812 00:26:09.267402 9441 tablet_service.cc:1514] Processing DeleteTablet for tablet 84298fe6725e47489331f182785bb16c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:26:09 UTC) from {username='slave'} at 127.0.0.1:52598
I20260812 00:26:09.267563 9853 tablet_replica.cc:330] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5: stopping tablet replica
I20260812 00:26:09.268076 9853 raft_consensus.cc:2229] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:26:09.268342 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 9373
I20260812 00:26:09.268626 9853 raft_consensus.cc:2258] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:26:09.274385 9855 tablet_replica.cc:330] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49: stopping tablet replica
I20260812 00:26:09.275099 9855 raft_consensus.cc:2229] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:26:09.275849 9855 raft_consensus.cc:2258] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:26:09.279147 9855 ts_tablet_manager.cc:1905] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:26:09.280378 9854 tablet_replica.cc:330] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd: stopping tablet replica
I20260812 00:26:09.280891 9854 raft_consensus.cc:2229] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:26:09.281715 9854 raft_consensus.cc:2258] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:26:09.283963 9853 ts_tablet_manager.cc:1905] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:26:09.284042 9854 ts_tablet_manager.cc:1905] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:26:09.287544 9855 ts_tablet_manager.cc:1918] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:26:09.287801 9855 log.cc:1196] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-0/wal/wals/84298fe6725e47489331f182785bb16c
I20260812 00:26:09.288496 9855 ts_tablet_manager.cc:1939] T 84298fe6725e47489331f182785bb16c P 7cbb581da6304722987255c145fd4d49: Deleting consensus metadata
I20260812 00:26:09.290524 9822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:09.269450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52614 (local address 127.18.163.193:33269)
0812 00:26:09.269682 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:09.269689 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:09.279973 (+ 10284us) server_negotiation.cc:407] Connection header received
0812 00:26:09.280441 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:09.280448 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:09.280567 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:09.280712 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:09.282127 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:09.283377 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:09.285410 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:09.286152 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:09.286257 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:09.288249 (+ 1992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:09.288267 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:09.288290 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:09.289200 (+ 910us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:09.289282 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:09.289310 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:09.289421 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:09.289956 (+ 535us) server_negotiation.cc:299] Negotiation successful
0812 00:26:09.290093 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 00:26:09.290773 9288 catalog_manager.cc:4841] TS 7cbb581da6304722987255c145fd4d49 (127.18.163.193:33269): tablet 84298fe6725e47489331f182785bb16c (table test-table [id=77f4af77d9a94099b997a25170bae6fb]) successfully deleted
I20260812 00:26:09.291615 9853 ts_tablet_manager.cc:1918] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:26:09.291810 9853 log.cc:1196] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-1/wal/wals/84298fe6725e47489331f182785bb16c
I20260812 00:26:09.291778 9854 ts_tablet_manager.cc:1918] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:26:09.291960 9854 log.cc:1196] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd: Deleting WAL directory at /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494024564100-19087-0/minicluster-data/ts-2/wal/wals/84298fe6725e47489331f182785bb16c
I20260812 00:26:09.292166 9512 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:09.292472 9853 ts_tablet_manager.cc:1939] T 84298fe6725e47489331f182785bb16c P 5c354c9313ff4e90aa648f5c01ff27d5: Deleting consensus metadata
I20260812 00:26:09.292544 9854 ts_tablet_manager.cc:1939] T 84298fe6725e47489331f182785bb16c P 8d2e305ba1044c1e95348c2cfcd654dd: Deleting consensus metadata
I20260812 00:26:09.294440 9288 catalog_manager.cc:4841] TS 8d2e305ba1044c1e95348c2cfcd654dd (127.18.163.195:41171): tablet 84298fe6725e47489331f182785bb16c (table test-table [id=77f4af77d9a94099b997a25170bae6fb]) successfully deleted
I20260812 00:26:09.294817 9288 catalog_manager.cc:4841] TS 5c354c9313ff4e90aa648f5c01ff27d5 (127.18.163.194:40009): tablet 84298fe6725e47489331f182785bb16c (table test-table [id=77f4af77d9a94099b997a25170bae6fb]) successfully deleted
I20260812 00:26:09.388988 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 9373
I20260812 00:26:09.413224 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 9521
I20260812 00:26:09.421670 9820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:09.414137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34496 (local address 127.18.163.194:40009)
0812 00:26:09.414309 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:09.414315 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:09.414358 (+ 43us) server_negotiation.cc:407] Connection header received
0812 00:26:09.414589 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:09.414593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:09.414724 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:09.414819 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:09.415308 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:09.416087 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:09.418047 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:09.418471 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:09.418571 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:09.419928 (+ 1357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:09.419937 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:09.419952 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:09.420699 (+ 747us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:09.420753 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:09.420774 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:09.420945 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:09.421091 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 00:26:09.421212 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 00:26:09.422593 9656 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:09.517002 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 9521
I20260812 00:26:09.541767 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 9665
I20260812 00:26:09.550113 9823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:09.542664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35712 (local address 127.18.163.195:41171)
0812 00:26:09.542870 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:09.542877 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:09.542902 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:26:09.543081 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:09.543087 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:09.543205 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:09.543334 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:09.543718 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:09.544871 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:09.546326 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:09.547026 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:09.547164 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:09.548310 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:09.548323 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:09.548344 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:09.549187 (+ 843us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:09.549294 (+ 107us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:09.549325 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:09.549454 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:09.549545 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 00:26:09.549691 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:26:09.551002 9799 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:09.676483 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 9665
I20260812 00:26:09.703616 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 9271
I20260812 00:26:09.704779 9339 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:09.821312 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 9271
2026-08-12T00:26:09Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3248 ms)
[----------] 6 tests from EncryptionPolicyTest (25287 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:09 dist-test-slave-njxd krb5kdc[9864](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:09 dist-test-slave-njxd krb5kdc[9864](info): set up 2 sockets
Aug 12 00:26:09 dist-test-slave-njxd krb5kdc[9864](info): commencing operation
krb5kdc: starting...
W20260812 00:26:11.068389 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.198s user 0.000s sys 0.063s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:11 dist-test-slave-njxd krb5kdc[9864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:26:11.459556 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45309
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45309
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:11.836258 9878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:11.836582 9878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:11.836769 9878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:11.844519 9878 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:11.844668 9878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:11.844781 9878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:11.844897 9878 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:11.844980 9878 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:11.856223 9878 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45309
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45309
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:11.857739 9878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:11.859230 9878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:11.872231 9883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:11.872184 9884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:11.872401 9886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:11.873184 9878 server_base.cc:1034] running on GCE node
I20260812 00:26:11.874136 9878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:11.875720 9878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:11.876945 9878 hybrid_clock.cc:648] HybridClock initialized: now 1786494371876893 us; error 35 us; skew 500 ppm
I20260812 00:26:11.877355 9878 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:11 dist-test-slave-njxd krb5kdc[9864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494371, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:11.880849 9878 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:26:11.882553 9878 webserver.cc:460] Webserver started at http://127.0.0.1:42295/ using document root <none> and password file <none>
I20260812 00:26:11.883299 9878 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:11.883414 9878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:11.883709 9878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:11.887032 9878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "6292ba656d3e4f0d91b6cec9ae6cf998"
format_stamp: "Formatted at 2026-08-12 00:26:11 on dist-test-slave-njxd"
server_key: "4a4bf9f97715a112e152e335599b7221"
server_key_iv: "5c7489bfe2df45083f9ed8ebe530c081"
server_key_version: "encryptionkey@0"
I20260812 00:26:11.887856 9878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "6292ba656d3e4f0d91b6cec9ae6cf998"
format_stamp: "Formatted at 2026-08-12 00:26:11 on dist-test-slave-njxd"
server_key: "4a4bf9f97715a112e152e335599b7221"
server_key_iv: "5c7489bfe2df45083f9ed8ebe530c081"
server_key_version: "encryptionkey@0"
I20260812 00:26:11.893743 9878 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 00:26:11.897774 9894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:11.899336 9878 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260812 00:26:11.899559 9878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "6292ba656d3e4f0d91b6cec9ae6cf998"
format_stamp: "Formatted at 2026-08-12 00:26:11 on dist-test-slave-njxd"
server_key: "4a4bf9f97715a112e152e335599b7221"
server_key_iv: "5c7489bfe2df45083f9ed8ebe530c081"
server_key_version: "encryptionkey@0"
I20260812 00:26:11.899796 9878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:11.923549 9878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:11.928332 9878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:11.928682 9878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:11.949203 9878 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45309
I20260812 00:26:11.949249 9949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45309 every 8 connection(s)
I20260812 00:26:11.950814 9878 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:11.955103 9951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:11.959012 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 9878
I20260812 00:26:11.959288 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:11.959968 19087 external_mini_cluster.cc:1428] Setting key 6061d3d35d3f8b38cb78c91f73b1580b
I20260812 00:26:11.967217 9951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998: Bootstrap starting.
I20260812 00:26:11.970976 9951 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:11.972142 9951 log.cc:824] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:11.975373 9951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998: No bootstrap required, opened a new log
Aug 12 00:26:11 dist-test-slave-njxd krb5kdc[9864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:26:11.983686 9951 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6292ba656d3e4f0d91b6cec9ae6cf998" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45309 } }
I20260812 00:26:11.984161 9951 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:11.984313 9951 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6292ba656d3e4f0d91b6cec9ae6cf998, State: Initialized, Role: FOLLOWER
I20260812 00:26:11.984956 9951 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6292ba656d3e4f0d91b6cec9ae6cf998" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45309 } }
I20260812 00:26:11.985272 9951 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:11.985437 9951 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:11.985687 9951 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:11.985972 9954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:11.962317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52335 (local address 127.0.0.1:45309)
0812 00:26:11.963154 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:11.963168 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:11.963214 (+ 46us) server_negotiation.cc:407] Connection header received
0812 00:26:11.965694 (+ 2480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:11.965722 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:11.966301 (+ 579us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:11.966722 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:11.968394 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:11.969988 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:11.971571 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:11.972389 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:11.972603 (+ 214us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:11.977141 (+ 4538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:11.977154 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:11.977171 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:11.977220 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:11.980802 (+ 3582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:11.981795 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:11.981803 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:11.981810 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:11.982012 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:11.982581 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:11.982585 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:11.982587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:11.983175 (+ 588us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:11.983554 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:11.984162 (+ 608us) server_negotiation.cc:299] Negotiation successful
0812 00:26:11.984575 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":358,"threads_started":1}
I20260812 00:26:11.988834 9951 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6292ba656d3e4f0d91b6cec9ae6cf998" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45309 } }
I20260812 00:26:11.989400 9951 leader_election.cc:302] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6292ba656d3e4f0d91b6cec9ae6cf998; no voters:
I20260812 00:26:11.990149 9951 leader_election.cc:288] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:11.990309 9956 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:11.990703 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:11.992575 9951 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:11.997540 9956 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [term 1 LEADER]: Becoming Leader. State: Replica: 6292ba656d3e4f0d91b6cec9ae6cf998, State: Running, Role: LEADER
I20260812 00:26:11.998538 9956 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6292ba656d3e4f0d91b6cec9ae6cf998" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45309 } }
I20260812 00:26:12.002389 9958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6292ba656d3e4f0d91b6cec9ae6cf998. Latest consensus state: current_term: 1 leader_uuid: "6292ba656d3e4f0d91b6cec9ae6cf998" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6292ba656d3e4f0d91b6cec9ae6cf998" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45309 } } }
I20260812 00:26:12.003083 9958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:12.002375 9957 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6292ba656d3e4f0d91b6cec9ae6cf998" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6292ba656d3e4f0d91b6cec9ae6cf998" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45309 } } }
I20260812 00:26:12.003793 9957 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998 [sys.catalog]: This master's current role is: LEADER
W20260812 00:26:12.010640 9977 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:26:12.010828 9977 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:26:12.011076 9978 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:12.013175 9978 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:12.019770 9954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:11.999462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56149 (local address 127.0.0.1:45309)
0812 00:26:11.999896 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:11.999902 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:11.999926 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:26:11.999995 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:12.000002 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:12.000122 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:12.000252 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:12.002559 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:12.004533 (+ 1974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:12.006910 (+ 2377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:12.007391 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:12.007540 (+ 149us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:12.011031 (+ 3491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:12.011042 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:12.011066 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:12.011112 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:12.015490 (+ 4378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:12.016714 (+ 1224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:12.016720 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:12.016724 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:12.016906 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:12.017557 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:12.017563 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:12.017566 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:12.018090 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:12.018389 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:12.019153 (+ 764us) server_negotiation.cc:299] Negotiation successful
0812 00:26:12.019373 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304}
I20260812 00:26:12.023070 9978 catalog_manager.cc:1347] Generated new cluster ID: 00853376d83d4f87b635bb0074be5730
I20260812 00:26:12.023214 9978 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:12.049463 9978 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:12.051644 9978 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:12.060330 9978 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6292ba656d3e4f0d91b6cec9ae6cf998: Generated new TSK 0
I20260812 00:26:12.061671 9978 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:12.076584 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 9878
I20260812 00:26:12.078423 9944 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:12.175983 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 9878
W20260812 00:26:12.200026 9862 connection.cc:535] client connection to 127.0.0.1:45309 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45309): Connection reset by peer (error 104)
2026-08-12T00:26:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2350 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:12 dist-test-slave-njxd krb5kdc[9985](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:12 dist-test-slave-njxd krb5kdc[9985](info): set up 2 sockets
Aug 12 00:26:12 dist-test-slave-njxd krb5kdc[9985](info): commencing operation
krb5kdc: starting...
W20260812 00:26:13.413552 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.000s sys 0.062s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:13 dist-test-slave-njxd krb5kdc[9985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:26:13.800403 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37653
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:14.168331 10000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:14.168666 10000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:14.168764 10000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:14.176550 10000 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:14.176687 10000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:14.176735 10000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:14.176800 10000 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:14.176846 10000 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:14.188064 10000 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37653
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:14.189466 10000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:14.190928 10000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:14.203600 10008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:14.203701 10005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:14.203764 10006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:14.204813 10000 server_base.cc:1034] running on GCE node
I20260812 00:26:14.205749 10000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:14.207261 10000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:14.208503 10000 hybrid_clock.cc:648] HybridClock initialized: now 1786494374208457 us; error 44 us; skew 500 ppm
I20260812 00:26:14.208876 10000 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:14 dist-test-slave-njxd krb5kdc[9985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494374, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:14.217222 10000 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:26:14.219095 10000 webserver.cc:460] Webserver started at http://127.0.0.1:35385/ using document root <none> and password file <none>
I20260812 00:26:14.219867 10000 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:14.220031 10000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:14.220382 10000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:14.223701 10000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "31777e09271b45aea6699e89d6e2949f"
format_stamp: "Formatted at 2026-08-12 00:26:14 on dist-test-slave-njxd"
server_key: "9640adeef0d303d0e864f7b161505f1f"
server_key_iv: "b99e18b2f189df9af8506ff5b3bd4dec"
server_key_version: "encryptionkey@0"
I20260812 00:26:14.224545 10000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "31777e09271b45aea6699e89d6e2949f"
format_stamp: "Formatted at 2026-08-12 00:26:14 on dist-test-slave-njxd"
server_key: "9640adeef0d303d0e864f7b161505f1f"
server_key_iv: "b99e18b2f189df9af8506ff5b3bd4dec"
server_key_version: "encryptionkey@0"
I20260812 00:26:14.230343 10000 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 00:26:14.234382 10015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:14.235949 10000 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260812 00:26:14.236186 10000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "31777e09271b45aea6699e89d6e2949f"
format_stamp: "Formatted at 2026-08-12 00:26:14 on dist-test-slave-njxd"
server_key: "9640adeef0d303d0e864f7b161505f1f"
server_key_iv: "b99e18b2f189df9af8506ff5b3bd4dec"
server_key_version: "encryptionkey@0"
I20260812 00:26:14.236423 10000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:14.256004 10000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:14.261026 10000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:14.261368 10000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:14.282166 10000 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37653
I20260812 00:26:14.282188 10072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37653 every 8 connection(s)
I20260812 00:26:14.283783 10000 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:14.288020 10073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:14.289933 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 10000
I20260812 00:26:14.290136 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:14.290745 19087 external_mini_cluster.cc:1428] Setting key bc6a87c4daf929fac24edd9b4b7a7535
I20260812 00:26:14.303831 10073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f: Bootstrap starting.
I20260812 00:26:14.305568 10076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:14.292737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55863 (local address 127.0.0.1:37653)
0812 00:26:14.293738 (+ 1001us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:14.293752 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:14.293802 (+ 50us) server_negotiation.cc:407] Connection header received
0812 00:26:14.295526 (+ 1724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:14.295558 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:14.296040 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:14.296403 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:14.297074 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:14.298471 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:14.300600 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:14.301411 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:14.301633 (+ 222us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:14.303028 (+ 1395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:14.303037 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:14.303053 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:14.303645 (+ 592us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:14.303737 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:14.303764 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:14.303898 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:14.304248 (+ 350us) server_negotiation.cc:299] Negotiation successful
0812 00:26:14.304484 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":691,"thread_start_us":443,"threads_started":1}
I20260812 00:26:14.307875 10073 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:14.309355 10073 log.cc:824] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:14.310279 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:14.313122 10073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f: No bootstrap required, opened a new log
I20260812 00:26:14.323105 10076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:14.315745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49715 (local address 127.0.0.1:37653)
0812 00:26:14.315966 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:14.315973 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:14.316585 (+ 612us) server_negotiation.cc:407] Connection header received
0812 00:26:14.316750 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:14.316756 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:14.316843 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:14.316961 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:14.317457 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:14.318658 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:14.320097 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:14.320872 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:14.321003 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:14.322280 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:14.322287 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:14.322292 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:14.322322 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:14.322396 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:14.322418 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:14.322549 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:14.322716 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 00:26:14.322778 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 00:26:14.323710 10073 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31777e09271b45aea6699e89d6e2949f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37653 } }
I20260812 00:26:14.324260 10073 raft_consensus.cc:374] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:14.324378 10073 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31777e09271b45aea6699e89d6e2949f, State: Initialized, Role: FOLLOWER
I20260812 00:26:14.325096 10073 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31777e09271b45aea6699e89d6e2949f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37653 } }
I20260812 00:26:14.325346 10073 raft_consensus.cc:388] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:14.325450 10073 raft_consensus.cc:482] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:14.325639 10073 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:14.328431 10073 raft_consensus.cc:504] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31777e09271b45aea6699e89d6e2949f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37653 } }
I20260812 00:26:14.329049 10073 leader_election.cc:302] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31777e09271b45aea6699e89d6e2949f; no voters:
I20260812 00:26:14.329756 10073 leader_election.cc:288] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:14.329932 10084 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:14.330781 10084 raft_consensus.cc:686] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [term 1 LEADER]: Becoming Leader. State: Replica: 31777e09271b45aea6699e89d6e2949f, State: Running, Role: LEADER
I20260812 00:26:14.331399 10084 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31777e09271b45aea6699e89d6e2949f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37653 } }
I20260812 00:26:14.332106 10073 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:14.334415 10086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31777e09271b45aea6699e89d6e2949f. Latest consensus state: current_term: 1 leader_uuid: "31777e09271b45aea6699e89d6e2949f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31777e09271b45aea6699e89d6e2949f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37653 } } }
I20260812 00:26:14.334957 10086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:14.334441 10085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "31777e09271b45aea6699e89d6e2949f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31777e09271b45aea6699e89d6e2949f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37653 } } }
I20260812 00:26:14.335773 10085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:14.336558 10091 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:14.349285 10091 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:14.359494 10091 catalog_manager.cc:1347] Generated new cluster ID: 7d403f679b7d491faccb718be2a7b792
I20260812 00:26:14.359632 10091 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:14.373191 10091 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:14.375308 10091 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:14.384245 10091 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 31777e09271b45aea6699e89d6e2949f: Generated new TSK 0
I20260812 00:26:14.385533 10091 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:14.402215 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 10000
W20260812 00:26:14.403633 10067 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55863
W20260812 00:26:14.404528 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 10000: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:26:14.404752 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 10000
W20260812 00:26:14.428182 9983 connection.cc:535] client connection to 127.0.0.1:37653 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37653): Connection reset by peer (error 104)
2026-08-12T00:26:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2227 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:14 dist-test-slave-njxd krb5kdc[10108](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:14 dist-test-slave-njxd krb5kdc[10108](info): set up 2 sockets
Aug 12 00:26:14 dist-test-slave-njxd krb5kdc[10108](info): commencing operation
krb5kdc: starting...
W20260812 00:26:15.641485 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.002s sys 0.060s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:15 dist-test-slave-njxd krb5kdc[10108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494375, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:26:16.029826 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37539
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37539
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:16.404973 10122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:16.405376 10122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:16.405635 10122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:16.413305 10122 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:16.413439 10122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:16.413554 10122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:16.413744 10122 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:16.413801 10122 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:16.424396 10122 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37539
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:16.425932 10122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:16.427405 10122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:16.441514 10127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:16.441618 10128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:16.441640 10131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:16.447325 10122 server_base.cc:1034] running on GCE node
I20260812 00:26:16.448302 10122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:16.450029 10122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:16.451304 10122 hybrid_clock.cc:648] HybridClock initialized: now 1786494376451252 us; error 41 us; skew 500 ppm
I20260812 00:26:16.451715 10122 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:16 dist-test-slave-njxd krb5kdc[10108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494376, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:16.455168 10122 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:26:16.456881 10122 webserver.cc:460] Webserver started at http://127.0.0.1:37249/ using document root <none> and password file <none>
I20260812 00:26:16.457707 10122 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:16.457858 10122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:16.458195 10122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:16.461330 10122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "be69c5652196480981152806f60ca4f2"
format_stamp: "Formatted at 2026-08-12 00:26:16 on dist-test-slave-njxd"
server_key: "4ecafdcd0cb241c1196a5e7151e66bfa"
server_key_iv: "3204a0af9082dc32ab1daf8b9accab72"
server_key_version: "encryptionkey@0"
I20260812 00:26:16.462234 10122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "be69c5652196480981152806f60ca4f2"
format_stamp: "Formatted at 2026-08-12 00:26:16 on dist-test-slave-njxd"
server_key: "4ecafdcd0cb241c1196a5e7151e66bfa"
server_key_iv: "3204a0af9082dc32ab1daf8b9accab72"
server_key_version: "encryptionkey@0"
I20260812 00:26:16.467949 10122 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260812 00:26:16.471880 10138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:16.473381 10122 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:26:16.473645 10122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "be69c5652196480981152806f60ca4f2"
format_stamp: "Formatted at 2026-08-12 00:26:16 on dist-test-slave-njxd"
server_key: "4ecafdcd0cb241c1196a5e7151e66bfa"
server_key_iv: "3204a0af9082dc32ab1daf8b9accab72"
server_key_version: "encryptionkey@0"
I20260812 00:26:16.473892 10122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:16.480597 10122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:16.485101 10122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:16.485440 10122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:16.505838 10122 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37539
I20260812 00:26:16.505873 10201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37539 every 8 connection(s)
I20260812 00:26:16.507381 10122 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:16.509209 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 10122
I20260812 00:26:16.509415 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:16.510069 19087 external_mini_cluster.cc:1428] Setting key 64e0d7e726986beb3340745b7bcc41d0
I20260812 00:26:16.512504 10202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:16.518710 10206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:16.512100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41003 (local address 127.0.0.1:37539)
0812 00:26:16.512984 (+ 884us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:16.512997 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:16.513045 (+ 48us) server_negotiation.cc:407] Connection header received
0812 00:26:16.514843 (+ 1798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:16.514866 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:16.515250 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:16.515620 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:16.516810 (+ 1190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:16.516818 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:16.516832 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:16.516847 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:16.516921 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:16.516942 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:16.517141 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:16.517284 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 00:26:16.517536 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":398,"threads_started":1}
I20260812 00:26:16.523113 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:16.525717 10202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2: Bootstrap starting.
I20260812 00:26:16.529037 10202 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:16.530391 10202 log.cc:824] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:16.533917 10202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2: No bootstrap required, opened a new log
I20260812 00:26:16.534250 10206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:16.531460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35899 (local address 127.0.0.1:37539)
0812 00:26:16.531670 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:16.531680 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:16.532052 (+ 372us) server_negotiation.cc:407] Connection header received
0812 00:26:16.532276 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:16.532287 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:16.532340 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:16.532452 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:16.533438 (+ 986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:16.533443 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:16.533448 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:16.533469 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:16.533519 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:16.533534 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:16.533685 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:16.533813 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 00:26:16.533883 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 00:26:16.541846 10202 raft_consensus.cc:348] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be69c5652196480981152806f60ca4f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37539 } }
I20260812 00:26:16.542272 10202 raft_consensus.cc:374] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:16.542351 10202 raft_consensus.cc:729] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be69c5652196480981152806f60ca4f2, State: Initialized, Role: FOLLOWER
I20260812 00:26:16.542980 10202 consensus_queue.cc:260] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be69c5652196480981152806f60ca4f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37539 } }
I20260812 00:26:16.543196 10202 raft_consensus.cc:388] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:16.543315 10202 raft_consensus.cc:482] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:16.543452 10202 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:16.545873 10202 raft_consensus.cc:504] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be69c5652196480981152806f60ca4f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37539 } }
I20260812 00:26:16.546394 10202 leader_election.cc:302] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be69c5652196480981152806f60ca4f2; no voters:
I20260812 00:26:16.547016 10202 leader_election.cc:288] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:16.547210 10213 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:16.547924 10213 raft_consensus.cc:686] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [term 1 LEADER]: Becoming Leader. State: Replica: be69c5652196480981152806f60ca4f2, State: Running, Role: LEADER
I20260812 00:26:16.548552 10213 consensus_queue.cc:237] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be69c5652196480981152806f60ca4f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37539 } }
I20260812 00:26:16.549366 10202 sys_catalog.cc:564] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:16.551671 10214 sys_catalog.cc:455] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be69c5652196480981152806f60ca4f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be69c5652196480981152806f60ca4f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37539 } } }
I20260812 00:26:16.552153 10214 sys_catalog.cc:458] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:16.552090 10215 sys_catalog.cc:455] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be69c5652196480981152806f60ca4f2. Latest consensus state: current_term: 1 leader_uuid: "be69c5652196480981152806f60ca4f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be69c5652196480981152806f60ca4f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37539 } } }
I20260812 00:26:16.552414 10215 sys_catalog.cc:458] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:16.554922 10219 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:16.560974 10219 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:16.571444 10219 catalog_manager.cc:1347] Generated new cluster ID: 7b7adf3a430646faaf16a34efed2916f
I20260812 00:26:16.571585 10219 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:16.591032 10219 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:16.591638 10219 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:16.601146 10219 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be69c5652196480981152806f60ca4f2: Generated new TSK 0
I20260812 00:26:16.602191 10219 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:16.617623 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 10122
W20260812 00:26:16.618927 10197 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:41003
W20260812 00:26:16.619768 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 10122: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:26:16.619931 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 10122
2026-08-12T00:26:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2216 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:16 dist-test-slave-njxd krb5kdc[10235](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:16 dist-test-slave-njxd krb5kdc[10235](info): set up 2 sockets
Aug 12 00:26:16 dist-test-slave-njxd krb5kdc[10235](info): commencing operation
krb5kdc: starting...
W20260812 00:26:17.863729 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.002s sys 0.062s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:18 dist-test-slave-njxd krb5kdc[10235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494378, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:26:18.258734 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37255
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37255
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:18.627977 10249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:18.628329 10249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:18.628504 10249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:18.635875 10249 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:18.636023 10249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:18.636118 10249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:18.636238 10249 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:18.636323 10249 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:18.646577 10249 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37255
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:18.648401 10249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:18.650013 10249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:18.662950 10254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:18.663105 10259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:18.663228 10255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:18.664052 10249 server_base.cc:1034] running on GCE node
I20260812 00:26:18.664917 10249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:18.666659 10249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:18.667871 10249 hybrid_clock.cc:648] HybridClock initialized: now 1786494378667824 us; error 49 us; skew 500 ppm
I20260812 00:26:18.668227 10249 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:18 dist-test-slave-njxd krb5kdc[10235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494378, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:18.671543 10249 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:26:18.673152 10249 webserver.cc:460] Webserver started at http://127.0.0.1:38367/ using document root <none> and password file <none>
I20260812 00:26:18.673988 10249 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:18.674155 10249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:18.674489 10249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:18.677875 10249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "250c8e0dc09343ca981ced2f33f16a36"
format_stamp: "Formatted at 2026-08-12 00:26:18 on dist-test-slave-njxd"
server_key: "42e2dd8a82d9b3b872b6fce0a8a8da0a"
server_key_iv: "98c3f19d252dbea4e3ae2eebfe881963"
server_key_version: "encryptionkey@0"
I20260812 00:26:18.678704 10249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "250c8e0dc09343ca981ced2f33f16a36"
format_stamp: "Formatted at 2026-08-12 00:26:18 on dist-test-slave-njxd"
server_key: "42e2dd8a82d9b3b872b6fce0a8a8da0a"
server_key_iv: "98c3f19d252dbea4e3ae2eebfe881963"
server_key_version: "encryptionkey@0"
I20260812 00:26:18.684641 10249 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260812 00:26:18.688611 10267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:18.690162 10249 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:26:18.690384 10249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "250c8e0dc09343ca981ced2f33f16a36"
format_stamp: "Formatted at 2026-08-12 00:26:18 on dist-test-slave-njxd"
server_key: "42e2dd8a82d9b3b872b6fce0a8a8da0a"
server_key_iv: "98c3f19d252dbea4e3ae2eebfe881963"
server_key_version: "encryptionkey@0"
I20260812 00:26:18.690642 10249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:18.710006 10249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:18.714336 10249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:18.714677 10249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:18.734723 10249 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37255
I20260812 00:26:18.734754 10324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37255 every 8 connection(s)
I20260812 00:26:18.736259 10249 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:18.736810 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 10249
I20260812 00:26:18.737030 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:18.737818 19087 external_mini_cluster.cc:1428] Setting key 68c8f7a0a8f39992589cd6ca8282f020
I20260812 00:26:18.741423 10325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 00:26:18 dist-test-slave-njxd krb5kdc[10235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494378, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:26:18.756222 10325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36: Bootstrap starting.
I20260812 00:26:18.760773 10325 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:18.762028 10325 log.cc:824] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:18.764174 10329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:18.739717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39183 (local address 127.0.0.1:37255)
0812 00:26:18.740551 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:18.740569 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:18.740613 (+ 44us) server_negotiation.cc:407] Connection header received
0812 00:26:18.742439 (+ 1826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:18.742465 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:18.742888 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:18.743236 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:18.745290 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:18.746792 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:18.748674 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:18.749388 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:18.749524 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:18.755005 (+ 5481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:18.755019 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:18.755043 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:18.755103 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:18.759358 (+ 4255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:18.760283 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:18.760293 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:18.760303 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:18.760558 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:18.761032 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:18.761035 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:18.761038 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:18.761751 (+ 713us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:18.762120 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:18.762609 (+ 489us) server_negotiation.cc:299] Negotiation successful
0812 00:26:18.763110 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":381,"threads_started":1}
I20260812 00:26:18.765300 10325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36: No bootstrap required, opened a new log
I20260812 00:26:18.768217 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:18.775900 10325 raft_consensus.cc:348] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "250c8e0dc09343ca981ced2f33f16a36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37255 } }
I20260812 00:26:18.776322 10325 raft_consensus.cc:374] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:18.776476 10325 raft_consensus.cc:729] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 250c8e0dc09343ca981ced2f33f16a36, State: Initialized, Role: FOLLOWER
I20260812 00:26:18.777094 10325 consensus_queue.cc:260] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "250c8e0dc09343ca981ced2f33f16a36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37255 } }
I20260812 00:26:18.777415 10325 raft_consensus.cc:388] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:18.777591 10325 raft_consensus.cc:482] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:18.777806 10325 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:18.780750 10325 raft_consensus.cc:504] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "250c8e0dc09343ca981ced2f33f16a36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37255 } }
I20260812 00:26:18.781386 10325 leader_election.cc:302] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 250c8e0dc09343ca981ced2f33f16a36; no voters:
I20260812 00:26:18.782130 10325 leader_election.cc:288] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:18.782246 10336 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:18.783461 10336 raft_consensus.cc:686] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [term 1 LEADER]: Becoming Leader. State: Replica: 250c8e0dc09343ca981ced2f33f16a36, State: Running, Role: LEADER
I20260812 00:26:18.784188 10336 consensus_queue.cc:237] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "250c8e0dc09343ca981ced2f33f16a36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37255 } }
I20260812 00:26:18.784801 10325 sys_catalog.cc:564] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:18.787485 10338 sys_catalog.cc:455] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 250c8e0dc09343ca981ced2f33f16a36. Latest consensus state: current_term: 1 leader_uuid: "250c8e0dc09343ca981ced2f33f16a36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "250c8e0dc09343ca981ced2f33f16a36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37255 } } }
I20260812 00:26:18.787902 10338 sys_catalog.cc:458] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:18.788406 10337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "250c8e0dc09343ca981ced2f33f16a36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "250c8e0dc09343ca981ced2f33f16a36" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37255 } } }
I20260812 00:26:18.788694 10337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:18.793566 10329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:18.773911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35677 (local address 127.0.0.1:37255)
0812 00:26:18.774142 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:18.774153 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:18.775043 (+ 890us) server_negotiation.cc:407] Connection header received
0812 00:26:18.775121 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:18.775125 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:18.775209 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:18.775331 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:18.777239 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:18.778400 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:18.779677 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:18.780346 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:18.780499 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:18.783688 (+ 3189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:18.783695 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:18.783700 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:18.783741 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:18.788063 (+ 4322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:18.789387 (+ 1324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:18.789396 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:18.789402 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:18.789666 (+ 264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:18.790313 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:18.790321 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:18.790327 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:18.790842 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:18.792459 (+ 1617us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:18.792684 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 00:26:18.793026 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:26:18.794230 10343 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:18.800345 10343 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:18.813382 10343 catalog_manager.cc:1347] Generated new cluster ID: 2cfb95aa2a2c4755af8f1ed447533abf
I20260812 00:26:18.813539 10343 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:18.825564 10343 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:18.827420 10343 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:18.837163 10343 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 250c8e0dc09343ca981ced2f33f16a36: Generated new TSK 0
I20260812 00:26:18.838177 10343 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:18.851277 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 10249
I20260812 00:26:18.852726 10320 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:18.947201 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 10249
2026-08-12T00:26:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2324 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:19 dist-test-slave-njxd krb5kdc[10361](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:19 dist-test-slave-njxd krb5kdc[10361](info): set up 2 sockets
Aug 12 00:26:19 dist-test-slave-njxd krb5kdc[10361](info): commencing operation
krb5kdc: starting...
W20260812 00:26:20.180951 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.006s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:20 dist-test-slave-njxd krb5kdc[10361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494380, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:26:20.574319 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39455
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39455
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:20.957155 10376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:20.957484 10376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:20.957653 10376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:20.965349 10376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:20.965493 10376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:20.965544 10376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:20.965684 10376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:20.965744 10376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:20.976943 10376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:20.978468 10376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:20.980021 10376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:20.993146 10381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:20.993535 10382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:20.993535 10384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:20.994529 10376 server_base.cc:1034] running on GCE node
I20260812 00:26:20.995543 10376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:20.997234 10376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:20.998497 10376 hybrid_clock.cc:648] HybridClock initialized: now 1786494380998441 us; error 54 us; skew 500 ppm
I20260812 00:26:20.998919 10376 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:20 dist-test-slave-njxd krb5kdc[10361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494380, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:21.006062 10376 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:26:21.007898 10376 webserver.cc:460] Webserver started at http://127.0.0.1:33619/ using document root <none> and password file <none>
I20260812 00:26:21.008670 10376 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:21.008810 10376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:21.009107 10376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:21.012526 10376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "b2327e7106bf4e2bb2804559c48ac0c2"
format_stamp: "Formatted at 2026-08-12 00:26:21 on dist-test-slave-njxd"
server_key: "8b534c6aba1cbc8869155f1c3c547a10"
server_key_iv: "6befe05d977df722840edcd6c93e72c2"
server_key_version: "encryptionkey@0"
I20260812 00:26:21.013733 10376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "b2327e7106bf4e2bb2804559c48ac0c2"
format_stamp: "Formatted at 2026-08-12 00:26:21 on dist-test-slave-njxd"
server_key: "8b534c6aba1cbc8869155f1c3c547a10"
server_key_iv: "6befe05d977df722840edcd6c93e72c2"
server_key_version: "encryptionkey@0"
I20260812 00:26:21.020056 10376 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:26:21.026078 10391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:21.028316 10376 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.002s
I20260812 00:26:21.028548 10376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "b2327e7106bf4e2bb2804559c48ac0c2"
format_stamp: "Formatted at 2026-08-12 00:26:21 on dist-test-slave-njxd"
server_key: "8b534c6aba1cbc8869155f1c3c547a10"
server_key_iv: "6befe05d977df722840edcd6c93e72c2"
server_key_version: "encryptionkey@0"
I20260812 00:26:21.028846 10376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:21.052524 10376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:21.059703 10376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:21.060086 10376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:21.082757 10446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39455 every 8 connection(s)
I20260812 00:26:21.082757 10376 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39455
I20260812 00:26:21.084769 10376 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:21.089190 10447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:21.094650 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 10376
I20260812 00:26:21.094879 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:21.095492 19087 external_mini_cluster.cc:1428] Setting key a1796640903696a2433f7536167e503a
I20260812 00:26:21.102216 10447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2: Bootstrap starting.
I20260812 00:26:21.105792 10447 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:21.107102 10447 log.cc:824] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:21.110409 10451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:21.097630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35425 (local address 127.0.0.1:39455)
0812 00:26:21.098575 (+ 945us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:21.098589 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:21.098635 (+ 46us) server_negotiation.cc:407] Connection header received
0812 00:26:21.100688 (+ 2053us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:21.100717 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:21.101201 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:21.101672 (+ 471us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:21.102350 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:21.103735 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:21.105230 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:21.106131 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:21.106371 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:21.107832 (+ 1461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:21.107841 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:21.107861 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:21.108495 (+ 634us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:21.108580 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:21.108607 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:21.108750 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:21.108996 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 00:26:21.109305 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":688,"thread_start_us":439,"threads_started":1}
I20260812 00:26:21.110683 10447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2: No bootstrap required, opened a new log
I20260812 00:26:21.114532 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:21.119378 10447 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2327e7106bf4e2bb2804559c48ac0c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39455 } }
I20260812 00:26:21.119997 10447 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:21.120129 10447 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2327e7106bf4e2bb2804559c48ac0c2, State: Initialized, Role: FOLLOWER
I20260812 00:26:21.120922 10447 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2327e7106bf4e2bb2804559c48ac0c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39455 } }
I20260812 00:26:21.121285 10447 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:21.121474 10447 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:21.121752 10447 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:21.125094 10447 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2327e7106bf4e2bb2804559c48ac0c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39455 } }
I20260812 00:26:21.125888 10447 leader_election.cc:302] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2327e7106bf4e2bb2804559c48ac0c2; no voters:
I20260812 00:26:21.126714 10447 leader_election.cc:288] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:21.126838 10461 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:21.127395 10451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:21.119378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58775 (local address 127.0.0.1:39455)
0812 00:26:21.119596 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:21.119602 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:21.120216 (+ 614us) server_negotiation.cc:407] Connection header received
0812 00:26:21.120447 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:21.120451 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:21.120555 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:21.120681 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:21.121425 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:21.122326 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:21.124299 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:21.124745 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:21.124844 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:21.126215 (+ 1371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:21.126220 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:21.126223 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:21.126245 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:21.126287 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:21.126304 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:21.126405 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:21.126626 (+ 221us) server_negotiation.cc:299] Negotiation successful
0812 00:26:21.126750 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 00:26:21.128664 10461 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [term 1 LEADER]: Becoming Leader. State: Replica: b2327e7106bf4e2bb2804559c48ac0c2, State: Running, Role: LEADER
I20260812 00:26:21.129375 10461 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2327e7106bf4e2bb2804559c48ac0c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39455 } }
I20260812 00:26:21.129626 10447 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:21.132643 10463 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2327e7106bf4e2bb2804559c48ac0c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2327e7106bf4e2bb2804559c48ac0c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39455 } } }
I20260812 00:26:21.133121 10463 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:21.133667 10464 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2327e7106bf4e2bb2804559c48ac0c2. Latest consensus state: current_term: 1 leader_uuid: "b2327e7106bf4e2bb2804559c48ac0c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2327e7106bf4e2bb2804559c48ac0c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39455 } } }
I20260812 00:26:21.133980 10464 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:21.139724 10471 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:21.144620 10471 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:21.154007 10471 catalog_manager.cc:1347] Generated new cluster ID: 57830e2749dd47c288e5d85812ac17aa
I20260812 00:26:21.154160 10471 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:21.180836 10471 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:21.182416 10471 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:21.190198 10471 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2327e7106bf4e2bb2804559c48ac0c2: Generated new TSK 0
I20260812 00:26:21.191128 10471 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:21.199582 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 10376
W20260812 00:26:21.201483 10440 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:35425
W20260812 00:26:21.202370 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 10376: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:26:21.202555 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 10376
2026-08-12T00:26:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2256 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:21 dist-test-slave-njxd krb5kdc[10484](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:21 dist-test-slave-njxd krb5kdc[10484](info): set up 2 sockets
Aug 12 00:26:21 dist-test-slave-njxd krb5kdc[10484](info): commencing operation
krb5kdc: starting...
W20260812 00:26:22.442137 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.002s sys 0.064s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:22 dist-test-slave-njxd krb5kdc[10484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:26:22.837345 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44969
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44969
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:23.217954 10499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:23.218281 10499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:23.218375 10499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:23.226300 10499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:23.226433 10499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:23.226482 10499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:23.226543 10499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:23.226595 10499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:23.237111 10499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44969
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:23.238576 10499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:23.239929 10499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:23.254431 10504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:23.254554 10505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:23.254576 10508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:23.255182 10499 server_base.cc:1034] running on GCE node
I20260812 00:26:23.256110 10499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:23.257766 10499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:23.259009 10499 hybrid_clock.cc:648] HybridClock initialized: now 1786494383258967 us; error 43 us; skew 500 ppm
I20260812 00:26:23.259407 10499 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:23 dist-test-slave-njxd krb5kdc[10484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494383, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:23.262900 10499 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:26:23.264693 10499 webserver.cc:460] Webserver started at http://127.0.0.1:34689/ using document root <none> and password file <none>
I20260812 00:26:23.265501 10499 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:23.265722 10499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:23.266080 10499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:23.269522 10499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "f4c5b52148954c7e9221e2a4080f4cd4"
format_stamp: "Formatted at 2026-08-12 00:26:23 on dist-test-slave-njxd"
server_key: "7cd551c74b6e2dc79cbd7683bdf85999"
server_key_iv: "555c5921d67ad3e5f5a164413cdcfa25"
server_key_version: "encryptionkey@0"
I20260812 00:26:23.270556 10499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "f4c5b52148954c7e9221e2a4080f4cd4"
format_stamp: "Formatted at 2026-08-12 00:26:23 on dist-test-slave-njxd"
server_key: "7cd551c74b6e2dc79cbd7683bdf85999"
server_key_iv: "555c5921d67ad3e5f5a164413cdcfa25"
server_key_version: "encryptionkey@0"
I20260812 00:26:23.276589 10499 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260812 00:26:23.280618 10515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:23.282188 10499 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:26:23.282402 10499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "f4c5b52148954c7e9221e2a4080f4cd4"
format_stamp: "Formatted at 2026-08-12 00:26:23 on dist-test-slave-njxd"
server_key: "7cd551c74b6e2dc79cbd7683bdf85999"
server_key_iv: "555c5921d67ad3e5f5a164413cdcfa25"
server_key_version: "encryptionkey@0"
I20260812 00:26:23.282629 10499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:23.289153 10499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:23.294037 10499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:23.294440 10499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:23.314806 10499 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44969
I20260812 00:26:23.314836 10569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44969 every 8 connection(s)
I20260812 00:26:23.316382 10499 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:23.320490 10570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:23.326500 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 10499
I20260812 00:26:23.326699 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:23.327272 19087 external_mini_cluster.cc:1428] Setting key 56ff7bed614407edb6975ca997d273b3
I20260812 00:26:23.332683 10570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4: Bootstrap starting.
I20260812 00:26:23.335803 10573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:23.329301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33053 (local address 127.0.0.1:44969)
0812 00:26:23.330302 (+ 1001us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:23.330317 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:23.330365 (+ 48us) server_negotiation.cc:407] Connection header received
0812 00:26:23.332117 (+ 1752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:23.332141 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:23.332523 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:23.332915 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:23.334139 (+ 1224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:23.334145 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:23.334158 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:23.334172 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:23.334240 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:23.334264 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:23.334431 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:23.334596 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 00:26:23.334810 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":729,"thread_start_us":474,"threads_started":1}
I20260812 00:26:23.336671 10570 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:23.337875 10570 log.cc:824] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:23.339869 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:23.341171 10570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4: No bootstrap required, opened a new log
I20260812 00:26:23.347453 10573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:23.344779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48115 (local address 127.0.0.1:44969)
0812 00:26:23.345002 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:23.345008 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:23.345379 (+ 371us) server_negotiation.cc:407] Connection header received
0812 00:26:23.345564 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:23.345568 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:23.345676 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:23.345770 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:23.346740 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:23.346744 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:23.346748 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:23.346767 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:23.346809 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:23.346825 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:23.346920 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:23.347068 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 00:26:23.347118 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 00:26:23.350198 10570 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4c5b52148954c7e9221e2a4080f4cd4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44969 } }
I20260812 00:26:23.350626 10570 raft_consensus.cc:374] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:23.350741 10570 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4c5b52148954c7e9221e2a4080f4cd4, State: Initialized, Role: FOLLOWER
I20260812 00:26:23.351384 10570 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4c5b52148954c7e9221e2a4080f4cd4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44969 } }
I20260812 00:26:23.351660 10570 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:23.351804 10570 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:23.351986 10570 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:23.354436 10570 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4c5b52148954c7e9221e2a4080f4cd4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44969 } }
I20260812 00:26:23.355000 10570 leader_election.cc:302] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4c5b52148954c7e9221e2a4080f4cd4; no voters:
I20260812 00:26:23.355597 10570 leader_election.cc:288] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:23.355767 10580 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:23.356483 10580 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [term 1 LEADER]: Becoming Leader. State: Replica: f4c5b52148954c7e9221e2a4080f4cd4, State: Running, Role: LEADER
I20260812 00:26:23.357023 10580 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4c5b52148954c7e9221e2a4080f4cd4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44969 } }
I20260812 00:26:23.357975 10570 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:23.361768 10582 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4c5b52148954c7e9221e2a4080f4cd4. Latest consensus state: current_term: 1 leader_uuid: "f4c5b52148954c7e9221e2a4080f4cd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4c5b52148954c7e9221e2a4080f4cd4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44969 } } }
I20260812 00:26:23.362264 10581 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4c5b52148954c7e9221e2a4080f4cd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4c5b52148954c7e9221e2a4080f4cd4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44969 } } }
I20260812 00:26:23.362641 10582 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:23.362627 10581 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:23.365212 10587 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:23.370659 10587 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:23.380604 10587 catalog_manager.cc:1347] Generated new cluster ID: cfc49eef5769415388408fabc8141674
I20260812 00:26:23.380746 10587 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:23.404027 10587 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:23.404646 10587 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:23.418730 10587 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f4c5b52148954c7e9221e2a4080f4cd4: Generated new TSK 0
I20260812 00:26:23.420010 10587 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:23.432581 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 10499
W20260812 00:26:23.433904 10565 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:33053
W20260812 00:26:23.434685 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 10499: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:26:23.434839 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 10499
2026-08-12T00:26:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2233 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:23 dist-test-slave-njxd krb5kdc[10602](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:23 dist-test-slave-njxd krb5kdc[10602](info): set up 2 sockets
Aug 12 00:26:23 dist-test-slave-njxd krb5kdc[10602](info): commencing operation
krb5kdc: starting...
W20260812 00:26:24.670861 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.000s sys 0.064s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:24 dist-test-slave-njxd krb5kdc[10602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:26:25.073215 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46195
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46195
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:25.455890 10617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:25.456214 10617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:25.456393 10617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:25.464079 10617 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:25.464236 10617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:25.464334 10617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:25.464435 10617 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:25.464510 10617 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:25.475147 10617 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46195
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46195
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:25.476563 10617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:25.477969 10617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:25.490199 10622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:25.490147 10625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:25.490229 10623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:25.491710 10617 server_base.cc:1034] running on GCE node
I20260812 00:26:25.492569 10617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:25.494282 10617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:25.495529 10617 hybrid_clock.cc:648] HybridClock initialized: now 1786494385495476 us; error 52 us; skew 500 ppm
I20260812 00:26:25.495932 10617 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:25 dist-test-slave-njxd krb5kdc[10602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494385, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:25.499460 10617 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:26:25.501384 10617 webserver.cc:460] Webserver started at http://127.0.0.1:37179/ using document root <none> and password file <none>
I20260812 00:26:25.502235 10617 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:25.502398 10617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:25.502794 10617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:25.506201 10617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "cc8bf1b9a21645c4b4626123ed48ed81"
format_stamp: "Formatted at 2026-08-12 00:26:25 on dist-test-slave-njxd"
server_key: "5267287a6c977d5bd33b242e43b561a8"
server_key_iv: "592dff6494fab4218e69b8ad005629fa"
server_key_version: "encryptionkey@0"
I20260812 00:26:25.507100 10617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "cc8bf1b9a21645c4b4626123ed48ed81"
format_stamp: "Formatted at 2026-08-12 00:26:25 on dist-test-slave-njxd"
server_key: "5267287a6c977d5bd33b242e43b561a8"
server_key_iv: "592dff6494fab4218e69b8ad005629fa"
server_key_version: "encryptionkey@0"
I20260812 00:26:25.513162 10617 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:26:25.517207 10632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:25.518817 10617 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:26:25.519045 10617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "cc8bf1b9a21645c4b4626123ed48ed81"
format_stamp: "Formatted at 2026-08-12 00:26:25 on dist-test-slave-njxd"
server_key: "5267287a6c977d5bd33b242e43b561a8"
server_key_iv: "592dff6494fab4218e69b8ad005629fa"
server_key_version: "encryptionkey@0"
I20260812 00:26:25.519282 10617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:25.544646 10617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:25.549094 10617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:25.549417 10617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:25.569885 10617 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46195
I20260812 00:26:25.569922 10692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46195 every 8 connection(s)
I20260812 00:26:25.571421 10617 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:25.574973 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 10617
I20260812 00:26:25.575199 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:25.575649 19087 external_mini_cluster.cc:1428] Setting key 784d025046bd5771f9110e04699f4b82
I20260812 00:26:25.575672 10693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:25.591625 10693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81: Bootstrap starting.
Aug 12 00:26:25 dist-test-slave-njxd krb5kdc[10602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:26:25.595439 10693 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:25.596604 10693 log.cc:824] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:25.600390 10693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81: No bootstrap required, opened a new log
I20260812 00:26:25.601646 10696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:25.577640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:54675 (local address 127.0.0.1:46195)
0812 00:26:25.578488 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:25.578503 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:25.578551 (+ 48us) server_negotiation.cc:407] Connection header received
0812 00:26:25.580618 (+ 2067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:25.580646 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:25.581123 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:25.581489 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:25.583766 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:25.585162 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:25.587115 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:25.587901 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:25.588063 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:25.593285 (+ 5222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:25.593294 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:25.593310 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:25.593355 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:25.596652 (+ 3297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:25.597840 (+ 1188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:25.597856 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:25.597866 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:25.598119 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:25.598689 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:25.598692 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:25.598694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:25.599260 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:25.599523 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:25.600111 (+ 588us) server_negotiation.cc:299] Negotiation successful
0812 00:26:25.600526 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":386,"threads_started":1}
I20260812 00:26:25.605839 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:25.609213 10693 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc8bf1b9a21645c4b4626123ed48ed81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46195 } }
I20260812 00:26:25.609673 10693 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:25.609797 10693 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc8bf1b9a21645c4b4626123ed48ed81, State: Initialized, Role: FOLLOWER
I20260812 00:26:25.610544 10693 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc8bf1b9a21645c4b4626123ed48ed81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46195 } }
I20260812 00:26:25.610845 10693 raft_consensus.cc:388] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:25.611027 10693 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:25.611230 10693 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:25.613564 10693 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc8bf1b9a21645c4b4626123ed48ed81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46195 } }
I20260812 00:26:25.614379 10693 leader_election.cc:302] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc8bf1b9a21645c4b4626123ed48ed81; no voters:
I20260812 00:26:25.615161 10693 leader_election.cc:288] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:25.615227 10703 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:25.617702 10693 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:25.622460 10703 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [term 1 LEADER]: Becoming Leader. State: Replica: cc8bf1b9a21645c4b4626123ed48ed81, State: Running, Role: LEADER
I20260812 00:26:25.623467 10703 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc8bf1b9a21645c4b4626123ed48ed81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46195 } }
I20260812 00:26:25.626760 10704 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc8bf1b9a21645c4b4626123ed48ed81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc8bf1b9a21645c4b4626123ed48ed81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46195 } } }
I20260812 00:26:25.627224 10704 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:25.627791 10705 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc8bf1b9a21645c4b4626123ed48ed81. Latest consensus state: current_term: 1 leader_uuid: "cc8bf1b9a21645c4b4626123ed48ed81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc8bf1b9a21645c4b4626123ed48ed81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46195 } } }
I20260812 00:26:25.628132 10705 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:25.638300 10715 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:25.639102 10696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:25.610743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:40123 (local address 127.0.0.1:46195)
0812 00:26:25.611000 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:25.611015 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:25.614298 (+ 3283us) server_negotiation.cc:407] Connection header received
0812 00:26:25.614519 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:25.614523 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:25.614630 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:25.614743 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:25.617045 (+ 2302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:25.618741 (+ 1696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:25.621336 (+ 2595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:25.622659 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:25.622842 (+ 183us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:25.627840 (+ 4998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:25.627852 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:25.627864 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:25.627939 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:25.633165 (+ 5226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:25.634871 (+ 1706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:25.634881 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:25.634887 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:25.635111 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:25.635885 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:25.635893 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:25.635899 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:25.636596 (+ 697us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:25.637001 (+ 405us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:25.638462 (+ 1461us) server_negotiation.cc:299] Negotiation successful
0812 00:26:25.638751 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 00:26:25.644606 10715 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:25.656050 10715 catalog_manager.cc:1347] Generated new cluster ID: d7797c4bb9b14102978e77863b4e150e
I20260812 00:26:25.656226 10715 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:25.671228 10715 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:25.672619 10715 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:25.679224 10715 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cc8bf1b9a21645c4b4626123ed48ed81: Generated new TSK 0
I20260812 00:26:25.680161 10715 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:25.689291 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 10617
I20260812 00:26:25.691138 10688 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:25.784492 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 10617
W20260812 00:26:25.808403 10599 connection.cc:535] client connection to 127.0.0.1:46195 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46195): Connection reset by peer (error 104)
2026-08-12T00:26:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2348 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:25 dist-test-slave-njxd krb5kdc[10727](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:25 dist-test-slave-njxd krb5kdc[10727](info): set up 2 sockets
Aug 12 00:26:25 dist-test-slave-njxd krb5kdc[10727](info): commencing operation
krb5kdc: starting...
W20260812 00:26:27.023121 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.000s sys 0.066s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:27 dist-test-slave-njxd krb5kdc[10727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494387, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:26:27.416913 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44559
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:27.788417 10741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:27.788749 10741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:27.788925 10741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:27.797441 10741 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:27.797631 10741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:27.797724 10741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:27.797847 10741 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:27.797927 10741 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:27.808959 10741 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:27.810469 10741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:27.811914 10741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:27.824525 10748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:27.824663 10752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:27.824728 10749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:27.825964 10741 server_base.cc:1034] running on GCE node
I20260812 00:26:27.826889 10741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:27.828454 10741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:27.829787 10741 hybrid_clock.cc:648] HybridClock initialized: now 1786494387829670 us; error 46 us; skew 500 ppm
I20260812 00:26:27.830209 10741 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:27 dist-test-slave-njxd krb5kdc[10727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494387, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:27.839888 10741 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:26:27.841765 10741 webserver.cc:460] Webserver started at http://127.0.0.1:45791/ using document root <none> and password file <none>
I20260812 00:26:27.842535 10741 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:27.842700 10741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:27.843034 10741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:27.846549 10741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "d07d3129acf24f2ba7c056277d536413"
format_stamp: "Formatted at 2026-08-12 00:26:27 on dist-test-slave-njxd"
server_key: "b5159b44605f9d2bbfe6ccc59e3c47d4"
server_key_iv: "77451c9e1e053742df21a48dce19579b"
server_key_version: "encryptionkey@0"
I20260812 00:26:27.847431 10741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "d07d3129acf24f2ba7c056277d536413"
format_stamp: "Formatted at 2026-08-12 00:26:27 on dist-test-slave-njxd"
server_key: "b5159b44605f9d2bbfe6ccc59e3c47d4"
server_key_iv: "77451c9e1e053742df21a48dce19579b"
server_key_version: "encryptionkey@0"
I20260812 00:26:27.853426 10741 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260812 00:26:27.857839 10760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:27.859484 10741 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:26:27.859747 10741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "d07d3129acf24f2ba7c056277d536413"
format_stamp: "Formatted at 2026-08-12 00:26:27 on dist-test-slave-njxd"
server_key: "b5159b44605f9d2bbfe6ccc59e3c47d4"
server_key_iv: "77451c9e1e053742df21a48dce19579b"
server_key_version: "encryptionkey@0"
I20260812 00:26:27.859992 10741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:27.879231 10741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:27.883970 10741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:27.884331 10741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:27.904896 10741 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44559
I20260812 00:26:27.904919 10822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44559 every 8 connection(s)
I20260812 00:26:27.906663 10741 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:27.910944 10825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:27.917065 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 10741
I20260812 00:26:27.917284 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:27.917819 19087 external_mini_cluster.cc:1428] Setting key 9f3fb16e4a75b70195cce6efb4166dfe
I20260812 00:26:27.922943 10825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413: Bootstrap starting.
I20260812 00:26:27.926961 10825 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:27.928328 10825 log.cc:824] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:27.931720 10825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413: No bootstrap required, opened a new log
I20260812 00:26:27.932790 10828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:27.920001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:58561 (local address 127.0.0.1:44559)
0812 00:26:27.920935 (+ 934us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:27.920948 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:27.920990 (+ 42us) server_negotiation.cc:407] Connection header received
0812 00:26:27.922839 (+ 1849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:27.922865 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:27.923356 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:27.923723 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:27.924438 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:27.925903 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:27.927932 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:27.928761 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:27.928948 (+ 187us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:27.930340 (+ 1392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:27.930348 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:27.930365 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:27.930952 (+ 587us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:27.931033 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:27.931061 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:27.931237 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:27.931535 (+ 298us) server_negotiation.cc:299] Negotiation successful
0812 00:26:27.931724 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":710,"thread_start_us":403,"threads_started":1}
I20260812 00:26:27.937424 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:27.941134 10825 raft_consensus.cc:348] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07d3129acf24f2ba7c056277d536413" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44559 } }
I20260812 00:26:27.941623 10825 raft_consensus.cc:374] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:27.941747 10825 raft_consensus.cc:729] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d07d3129acf24f2ba7c056277d536413, State: Initialized, Role: FOLLOWER
I20260812 00:26:27.942589 10825 consensus_queue.cc:260] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07d3129acf24f2ba7c056277d536413" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44559 } }
I20260812 00:26:27.942941 10825 raft_consensus.cc:388] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:27.943110 10825 raft_consensus.cc:482] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:27.943324 10825 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:27.945885 10825 raft_consensus.cc:504] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07d3129acf24f2ba7c056277d536413" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44559 } }
I20260812 00:26:27.946463 10825 leader_election.cc:302] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d07d3129acf24f2ba7c056277d536413; no voters:
I20260812 00:26:27.947192 10825 leader_election.cc:288] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:27.947355 10836 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:27.949750 10836 raft_consensus.cc:686] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [term 1 LEADER]: Becoming Leader. State: Replica: d07d3129acf24f2ba7c056277d536413, State: Running, Role: LEADER
I20260812 00:26:27.950456 10828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:27.942397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:35367 (local address 127.0.0.1:44559)
0812 00:26:27.942609 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:27.942618 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:27.943020 (+ 402us) server_negotiation.cc:407] Connection header received
0812 00:26:27.943260 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:27.943266 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:27.943355 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:27.943459 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:27.944046 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:27.944865 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:27.946345 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:27.947051 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:27.947207 (+ 156us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:27.948832 (+ 1625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:27.948842 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:27.948850 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:27.948883 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:27.949124 (+ 241us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:27.949156 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:27.949314 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:27.950020 (+ 706us) server_negotiation.cc:299] Negotiation successful
0812 00:26:27.950100 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 00:26:27.950785 10825 sys_catalog.cc:564] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:27.950426 10836 consensus_queue.cc:237] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07d3129acf24f2ba7c056277d536413" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44559 } }
I20260812 00:26:27.954495 10840 sys_catalog.cc:455] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d07d3129acf24f2ba7c056277d536413. Latest consensus state: current_term: 1 leader_uuid: "d07d3129acf24f2ba7c056277d536413" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07d3129acf24f2ba7c056277d536413" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44559 } } }
I20260812 00:26:27.954521 10839 sys_catalog.cc:455] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d07d3129acf24f2ba7c056277d536413" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07d3129acf24f2ba7c056277d536413" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44559 } } }
I20260812 00:26:27.955070 10840 sys_catalog.cc:458] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:27.955076 10839 sys_catalog.cc:458] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:27.956673 10847 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:27.962910 10847 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:27.974184 10847 catalog_manager.cc:1347] Generated new cluster ID: ea51f98ebc9f4ed590a4ab901eeea1f3
I20260812 00:26:27.974329 10847 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:27.995347 10847 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:27.996733 10847 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:28.004462 10847 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d07d3129acf24f2ba7c056277d536413: Generated new TSK 0
I20260812 00:26:28.005362 10847 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:28.019919 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 10741
W20260812 00:26:28.021440 10818 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.106:58561
W20260812 00:26:28.022274 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 10741: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:26:28.022423 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 10741
W20260812 00:26:28.044638 10725 connection.cc:535] client connection to 127.0.0.1:44559 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44559): Connection reset by peer (error 104)
2026-08-12T00:26:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2237 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:28 dist-test-slave-njxd krb5kdc[10860](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:28 dist-test-slave-njxd krb5kdc[10860](info): set up 2 sockets
Aug 12 00:26:28 dist-test-slave-njxd krb5kdc[10860](info): commencing operation
krb5kdc: starting...
W20260812 00:26:29.258311 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.004s sys 0.061s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:29 dist-test-slave-njxd krb5kdc[10860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494389, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:26:29.657226 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33481
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33481
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:30.033787 10873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:30.034122 10873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:30.034220 10873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:30.041795 10873 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:30.041934 10873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:30.041989 10873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:30.042053 10873 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:30.042098 10873 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:30.052404 10873 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33481
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33481
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:30.053823 10873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:30.055182 10873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:30.067647 10878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:30.067688 10880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:30.067823 10882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:30.068936 10873 server_base.cc:1034] running on GCE node
I20260812 00:26:30.069890 10873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:30.071445 10873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:30.072672 10873 hybrid_clock.cc:648] HybridClock initialized: now 1786494390072619 us; error 51 us; skew 500 ppm
I20260812 00:26:30.073074 10873 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:30 dist-test-slave-njxd krb5kdc[10860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494390, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:30.076498 10873 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:26:30.078302 10873 webserver.cc:460] Webserver started at http://127.0.0.1:34713/ using document root <none> and password file <none>
I20260812 00:26:30.079092 10873 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:30.079257 10873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:30.079596 10873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:30.082899 10873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "f747f036f5754639af5cb4f322ee50bd"
format_stamp: "Formatted at 2026-08-12 00:26:30 on dist-test-slave-njxd"
server_key: "77a38b49ce2caab062c212feb06e3016"
server_key_iv: "299b2609b14686b75348004f32775cbd"
server_key_version: "encryptionkey@0"
I20260812 00:26:30.083779 10873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "f747f036f5754639af5cb4f322ee50bd"
format_stamp: "Formatted at 2026-08-12 00:26:30 on dist-test-slave-njxd"
server_key: "77a38b49ce2caab062c212feb06e3016"
server_key_iv: "299b2609b14686b75348004f32775cbd"
server_key_version: "encryptionkey@0"
I20260812 00:26:30.089815 10873 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 00:26:30.093806 10889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:30.095366 10873 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:26:30.095594 10873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "f747f036f5754639af5cb4f322ee50bd"
format_stamp: "Formatted at 2026-08-12 00:26:30 on dist-test-slave-njxd"
server_key: "77a38b49ce2caab062c212feb06e3016"
server_key_iv: "299b2609b14686b75348004f32775cbd"
server_key_version: "encryptionkey@0"
I20260812 00:26:30.095832 10873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:30.102348 10873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:30.106695 10873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:30.107031 10873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:30.127101 10873 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33481
I20260812 00:26:30.127149 10946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33481 every 8 connection(s)
I20260812 00:26:30.128640 10873 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:30.132701 10947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:30.137035 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 10873
I20260812 00:26:30.137244 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:30.137902 19087 external_mini_cluster.cc:1428] Setting key 5d89a163e406809a48e838d49a441a3c
I20260812 00:26:30.146298 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:30.139846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:50101 (local address 127.0.0.1:33481)
0812 00:26:30.140680 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:30.140692 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:30.140736 (+ 44us) server_negotiation.cc:407] Connection header received
0812 00:26:30.142510 (+ 1774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:30.142534 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:30.142941 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:30.143400 (+ 459us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:30.144540 (+ 1140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:30.144547 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:30.144560 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:30.144576 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:30.144634 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:30.144653 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:30.144890 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:30.145048 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 00:26:30.145259 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":365,"threads_started":1}
I20260812 00:26:30.146420 10947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd: Bootstrap starting.
I20260812 00:26:30.150250 10947 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:30.150300 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:30.151343 10947 log.cc:824] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:30.154772 10947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd: No bootstrap required, opened a new log
I20260812 00:26:30.158011 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:30.155203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:46483 (local address 127.0.0.1:33481)
0812 00:26:30.155419 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:30.155426 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:30.155962 (+ 536us) server_negotiation.cc:407] Connection header received
0812 00:26:30.156133 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:30.156139 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:30.156205 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:30.156324 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:30.157261 (+ 937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:30.157267 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:30.157272 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:30.157292 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:30.157351 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:30.157371 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:30.157505 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:30.157568 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 00:26:30.157687 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 00:26:30.164299 10947 raft_consensus.cc:348] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f747f036f5754639af5cb4f322ee50bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33481 } }
I20260812 00:26:30.164829 10947 raft_consensus.cc:374] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:30.164952 10947 raft_consensus.cc:729] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f747f036f5754639af5cb4f322ee50bd, State: Initialized, Role: FOLLOWER
I20260812 00:26:30.165647 10947 consensus_queue.cc:260] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f747f036f5754639af5cb4f322ee50bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33481 } }
I20260812 00:26:30.165912 10947 raft_consensus.cc:388] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:30.166069 10947 raft_consensus.cc:482] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:30.166249 10947 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:30.168776 10947 raft_consensus.cc:504] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f747f036f5754639af5cb4f322ee50bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33481 } }
I20260812 00:26:30.169340 10947 leader_election.cc:302] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f747f036f5754639af5cb4f322ee50bd; no voters:
I20260812 00:26:30.169976 10947 leader_election.cc:288] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:30.170141 10957 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:30.170924 10957 raft_consensus.cc:686] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [term 1 LEADER]: Becoming Leader. State: Replica: f747f036f5754639af5cb4f322ee50bd, State: Running, Role: LEADER
I20260812 00:26:30.171507 10957 consensus_queue.cc:237] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f747f036f5754639af5cb4f322ee50bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33481 } }
I20260812 00:26:30.172219 10947 sys_catalog.cc:564] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:30.174846 10960 sys_catalog.cc:455] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader f747f036f5754639af5cb4f322ee50bd. Latest consensus state: current_term: 1 leader_uuid: "f747f036f5754639af5cb4f322ee50bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f747f036f5754639af5cb4f322ee50bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33481 } } }
I20260812 00:26:30.174713 10958 sys_catalog.cc:455] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f747f036f5754639af5cb4f322ee50bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f747f036f5754639af5cb4f322ee50bd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33481 } } }
I20260812 00:26:30.175247 10960 sys_catalog.cc:458] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:30.175249 10958 sys_catalog.cc:458] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:30.176367 10965 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:30.182017 10965 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:30.193629 10965 catalog_manager.cc:1347] Generated new cluster ID: fa0dbf4925d34e9d8cd5cbf11c4231d2
I20260812 00:26:30.193781 10965 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:30.209981 10965 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:30.210491 10965 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:30.234437 10965 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f747f036f5754639af5cb4f322ee50bd: Generated new TSK 0
I20260812 00:26:30.235420 10965 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:30.240545 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 10873
W20260812 00:26:30.242141 10940 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.106:50101
W20260812 00:26:30.243011 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 10873: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:26:30.243176 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 10873
2026-08-12T00:26:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2220 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:30 dist-test-slave-njxd krb5kdc[10984](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:30 dist-test-slave-njxd krb5kdc[10984](info): set up 2 sockets
Aug 12 00:26:30 dist-test-slave-njxd krb5kdc[10984](info): commencing operation
krb5kdc: starting...
W20260812 00:26:31.480967 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.001s sys 0.064s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:31 dist-test-slave-njxd krb5kdc[10984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494391, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:26:31.869716 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37931
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37931
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:32.241984 10999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:32.242311 10999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:32.242502 10999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:32.249979 10999 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:32.250101 10999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:32.250222 10999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:32.250305 10999 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:32.250384 10999 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:32.261832 10999 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37931
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:32.263352 10999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:32.264954 10999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:32.278395 11005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:32.278407 11007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:32.278430 11004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:32.279424 10999 server_base.cc:1034] running on GCE node
I20260812 00:26:32.280238 10999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:32.281804 10999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:32.283046 10999 hybrid_clock.cc:648] HybridClock initialized: now 1786494392282967 us; error 61 us; skew 500 ppm
I20260812 00:26:32.283396 10999 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:32 dist-test-slave-njxd krb5kdc[10984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494392, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:32.286949 10999 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:26:32.288594 10999 webserver.cc:460] Webserver started at http://127.0.0.1:38967/ using document root <none> and password file <none>
I20260812 00:26:32.289294 10999 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:32.289420 10999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:32.289806 10999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:32.292965 10999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "79f515425ef64d3f904fd61eaa60f489"
format_stamp: "Formatted at 2026-08-12 00:26:32 on dist-test-slave-njxd"
server_key: "71756c44698daaf5eee30239e609dce6"
server_key_iv: "2a5e10d8c78641ac0f079241b2e417b8"
server_key_version: "encryptionkey@0"
I20260812 00:26:32.293848 10999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "79f515425ef64d3f904fd61eaa60f489"
format_stamp: "Formatted at 2026-08-12 00:26:32 on dist-test-slave-njxd"
server_key: "71756c44698daaf5eee30239e609dce6"
server_key_iv: "2a5e10d8c78641ac0f079241b2e417b8"
server_key_version: "encryptionkey@0"
I20260812 00:26:32.299575 10999 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 00:26:32.303543 11014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:32.305135 10999 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:26:32.305373 10999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "79f515425ef64d3f904fd61eaa60f489"
format_stamp: "Formatted at 2026-08-12 00:26:32 on dist-test-slave-njxd"
server_key: "71756c44698daaf5eee30239e609dce6"
server_key_iv: "2a5e10d8c78641ac0f079241b2e417b8"
server_key_version: "encryptionkey@0"
I20260812 00:26:32.305662 10999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:32.324455 10999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:32.329275 10999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:32.329666 10999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:32.350171 10999 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37931
I20260812 00:26:32.350206 11071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37931 every 8 connection(s)
I20260812 00:26:32.351747 10999 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:32.355949 11072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:32.358788 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 10999
I20260812 00:26:32.359007 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:32.359469 19087 external_mini_cluster.cc:1428] Setting key 5b5f466e43a780dfc4c92813cc23f6cc
I20260812 00:26:32.370558 11072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489: Bootstrap starting.
I20260812 00:26:32.374699 11072 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:32.375887 11072 log.cc:824] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489: Log is configured to *not* fsync() on all Append() calls
Aug 12 00:26:32 dist-test-slave-njxd krb5kdc[10984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494391, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:26:32.380035 11072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489: No bootstrap required, opened a new log
I20260812 00:26:32.387538 11076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:32.361674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:46701 (local address 127.0.0.1:37931)
0812 00:26:32.362617 (+ 943us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:32.362636 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:32.362695 (+ 59us) server_negotiation.cc:407] Connection header received
0812 00:26:32.365173 (+ 2478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:32.365208 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:32.365864 (+ 656us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:32.366399 (+ 535us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:32.367827 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:32.369894 (+ 2067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:32.371394 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:32.372540 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:32.372786 (+ 246us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:32.377775 (+ 4989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:32.377789 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:32.377812 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:32.377858 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:32.382081 (+ 4223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:32.383155 (+ 1074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:32.383166 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:32.383181 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:32.383434 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:32.383900 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:32.383905 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:32.383909 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:32.384720 (+ 811us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:32.385046 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:32.385537 (+ 491us) server_negotiation.cc:299] Negotiation successful
0812 00:26:32.385964 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":368,"threads_started":1}
I20260812 00:26:32.391137 11072 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79f515425ef64d3f904fd61eaa60f489" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37931 } }
I20260812 00:26:32.391672 11072 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:32.391795 11072 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f515425ef64d3f904fd61eaa60f489, State: Initialized, Role: FOLLOWER
I20260812 00:26:32.392417 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:32.392508 11072 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79f515425ef64d3f904fd61eaa60f489" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37931 } }
I20260812 00:26:32.392805 11072 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:32.392956 11072 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:32.393147 11072 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:32.395615 11072 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79f515425ef64d3f904fd61eaa60f489" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37931 } }
I20260812 00:26:32.396341 11072 leader_election.cc:302] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79f515425ef64d3f904fd61eaa60f489; no voters:
I20260812 00:26:32.397022 11072 leader_election.cc:288] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:32.397169 11084 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:32.400028 11072 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:32.403792 11084 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [term 1 LEADER]: Becoming Leader. State: Replica: 79f515425ef64d3f904fd61eaa60f489, State: Running, Role: LEADER
I20260812 00:26:32.404682 11084 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79f515425ef64d3f904fd61eaa60f489" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37931 } }
I20260812 00:26:32.407843 11085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79f515425ef64d3f904fd61eaa60f489" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79f515425ef64d3f904fd61eaa60f489" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37931 } } }
I20260812 00:26:32.408283 11085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:32.408804 11086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79f515425ef64d3f904fd61eaa60f489. Latest consensus state: current_term: 1 leader_uuid: "79f515425ef64d3f904fd61eaa60f489" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79f515425ef64d3f904fd61eaa60f489" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37931 } } }
I20260812 00:26:32.409137 11086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:32.427582 11076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:32.397644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:46605 (local address 127.0.0.1:37931)
0812 00:26:32.397859 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:32.397867 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:32.402423 (+ 4556us) server_negotiation.cc:407] Connection header received
0812 00:26:32.402713 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:32.402722 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:32.402846 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:32.402987 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:32.405659 (+ 2672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:32.407208 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:32.410012 (+ 2804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:32.411239 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:32.411393 (+ 154us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:32.416290 (+ 4897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:32.416302 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:32.416310 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:32.416378 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:32.421359 (+ 4981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:32.422970 (+ 1611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:32.422978 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:32.422985 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:32.423189 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:32.423982 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:32.423989 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:32.423994 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:32.424492 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:32.424865 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:32.426734 (+ 1869us) server_negotiation.cc:299] Negotiation successful
0812 00:26:32.427011 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 00:26:32.432753 11097 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:32.438299 11097 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:32.448249 11097 catalog_manager.cc:1347] Generated new cluster ID: e5eb8fd442954aaa92fc69f07a6eb7c1
I20260812 00:26:32.448398 11097 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:32.472110 11097 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:32.473490 11097 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:32.481532 11097 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79f515425ef64d3f904fd61eaa60f489: Generated new TSK 0
I20260812 00:26:32.482784 11097 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:32.496402 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 10999
I20260812 00:26:32.497764 11066 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:32.593113 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 10999
W20260812 00:26:32.617434 10981 connection.cc:535] client connection to 127.0.0.1:37931 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37931): Connection reset by peer (error 104)
2026-08-12T00:26:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2350 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:32 dist-test-slave-njxd krb5kdc[11112](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:32 dist-test-slave-njxd krb5kdc[11112](info): set up 2 sockets
Aug 12 00:26:32 dist-test-slave-njxd krb5kdc[11112](info): commencing operation
krb5kdc: starting...
W20260812 00:26:33.834853 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.197s user 0.003s sys 0.062s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:34 dist-test-slave-njxd krb5kdc[11112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494394, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:26:34.253456 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33849
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33849
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:34.624878 11127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:34.625247 11127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:34.625420 11127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:34.632917 11127 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:34.633100 11127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:34.633222 11127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:34.633337 11127 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:34.633426 11127 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:34.643981 11127 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33849
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:34.645473 11127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:34.646994 11127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:34.660209 11133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:34.660298 11136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:34.660329 11134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:34.661360 11127 server_base.cc:1034] running on GCE node
I20260812 00:26:34.662331 11127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:34.664024 11127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:34.665324 11127 hybrid_clock.cc:648] HybridClock initialized: now 1786494394665247 us; error 72 us; skew 500 ppm
I20260812 00:26:34.665836 11127 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:34 dist-test-slave-njxd krb5kdc[11112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494394, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:34.674146 11127 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:26:34.675976 11127 webserver.cc:460] Webserver started at http://127.0.0.1:43995/ using document root <none> and password file <none>
I20260812 00:26:34.676736 11127 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:34.676847 11127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:34.677130 11127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:34.680454 11127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "25e0a891d07b4e2fb61c97bd390c24f5"
format_stamp: "Formatted at 2026-08-12 00:26:34 on dist-test-slave-njxd"
server_key: "79aa6bb9741a3bb3cefa9647e3737eb9"
server_key_iv: "67f3ab7a8921e5103fb595743c49fa49"
server_key_version: "encryptionkey@0"
I20260812 00:26:34.681273 11127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "25e0a891d07b4e2fb61c97bd390c24f5"
format_stamp: "Formatted at 2026-08-12 00:26:34 on dist-test-slave-njxd"
server_key: "79aa6bb9741a3bb3cefa9647e3737eb9"
server_key_iv: "67f3ab7a8921e5103fb595743c49fa49"
server_key_version: "encryptionkey@0"
I20260812 00:26:34.687178 11127 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260812 00:26:34.691030 11143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:34.692727 11127 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:26:34.692900 11127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "25e0a891d07b4e2fb61c97bd390c24f5"
format_stamp: "Formatted at 2026-08-12 00:26:34 on dist-test-slave-njxd"
server_key: "79aa6bb9741a3bb3cefa9647e3737eb9"
server_key_iv: "67f3ab7a8921e5103fb595743c49fa49"
server_key_version: "encryptionkey@0"
I20260812 00:26:34.693090 11127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:34.733016 11127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:34.738097 11127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:34.738394 11127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:34.758713 11127 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33849
I20260812 00:26:34.758746 11200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33849 every 8 connection(s)
I20260812 00:26:34.760283 11127 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:34.763739 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 11127
I20260812 00:26:34.763985 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:34.764508 19087 external_mini_cluster.cc:1428] Setting key 538041935e301199e4d0bc6dc9595493
I20260812 00:26:34.765344 11201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:34.781077 11204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:34.766745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:51883 (local address 127.0.0.1:33849)
0812 00:26:34.767671 (+ 926us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:34.767688 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:34.767749 (+ 61us) server_negotiation.cc:407] Connection header received
0812 00:26:34.769564 (+ 1815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:34.769643 (+ 79us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:34.770292 (+ 649us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:34.770794 (+ 502us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:34.771372 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:34.773513 (+ 2141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:34.775061 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:34.776173 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:34.776387 (+ 214us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:34.777798 (+ 1411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:34.777809 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:34.777830 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:34.778668 (+ 838us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:34.778780 (+ 112us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:34.778815 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:34.778991 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:34.779436 (+ 445us) server_negotiation.cc:299] Negotiation successful
0812 00:26:34.779659 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":358,"threads_started":1}
I20260812 00:26:34.782029 11201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5: Bootstrap starting.
I20260812 00:26:34.785976 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:34.786211 11201 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:34.787341 11201 log.cc:824] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:34.790817 11201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5: No bootstrap required, opened a new log
I20260812 00:26:34.798780 11204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:34.791192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:37171 (local address 127.0.0.1:33849)
0812 00:26:34.791421 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:34.791433 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:34.791901 (+ 468us) server_negotiation.cc:407] Connection header received
0812 00:26:34.792076 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:34.792082 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:34.792166 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:34.792300 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:34.792896 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:34.794196 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:34.795576 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:34.796306 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:34.796465 (+ 159us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:34.797832 (+ 1367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:34.797839 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:34.797844 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:34.797876 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:34.797957 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:34.797986 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:34.798109 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:34.798348 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 00:26:34.798408 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 00:26:34.801828 11201 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e0a891d07b4e2fb61c97bd390c24f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33849 } }
I20260812 00:26:34.802282 11201 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:34.802416 11201 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25e0a891d07b4e2fb61c97bd390c24f5, State: Initialized, Role: FOLLOWER
I20260812 00:26:34.803035 11201 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e0a891d07b4e2fb61c97bd390c24f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33849 } }
I20260812 00:26:34.803308 11201 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:34.803488 11201 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:34.803673 11201 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:34.806232 11201 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e0a891d07b4e2fb61c97bd390c24f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33849 } }
I20260812 00:26:34.806905 11201 leader_election.cc:302] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25e0a891d07b4e2fb61c97bd390c24f5; no voters:
I20260812 00:26:34.807703 11201 leader_election.cc:288] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:34.807884 11211 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:34.808645 11211 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [term 1 LEADER]: Becoming Leader. State: Replica: 25e0a891d07b4e2fb61c97bd390c24f5, State: Running, Role: LEADER
I20260812 00:26:34.809288 11211 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e0a891d07b4e2fb61c97bd390c24f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33849 } }
I20260812 00:26:34.810134 11201 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:34.812791 11213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25e0a891d07b4e2fb61c97bd390c24f5. Latest consensus state: current_term: 1 leader_uuid: "25e0a891d07b4e2fb61c97bd390c24f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e0a891d07b4e2fb61c97bd390c24f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33849 } } }
I20260812 00:26:34.813318 11213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:34.812844 11212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25e0a891d07b4e2fb61c97bd390c24f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e0a891d07b4e2fb61c97bd390c24f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33849 } } }
I20260812 00:26:34.813642 11212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:34.815548 11219 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:34.821254 11219 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:34.831565 11219 catalog_manager.cc:1347] Generated new cluster ID: 19585a576e7b4b6f8b154a03a90e256f
I20260812 00:26:34.831717 11219 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:34.854445 11219 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:34.855916 11219 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:34.862761 11219 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25e0a891d07b4e2fb61c97bd390c24f5: Generated new TSK 0
I20260812 00:26:34.863686 11219 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:34.871505 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 11127
W20260812 00:26:34.872918 11196 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.106:51883
W20260812 00:26:34.873831 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 11127: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:26:34.874032 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 11127
W20260812 00:26:34.900067 11109 connection.cc:535] client connection to 127.0.0.1:33849 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33849): Connection reset by peer (error 104)
2026-08-12T00:26:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2285 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:35 dist-test-slave-njxd krb5kdc[11233](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:35 dist-test-slave-njxd krb5kdc[11233](info): set up 2 sockets
Aug 12 00:26:35 dist-test-slave-njxd krb5kdc[11233](info): commencing operation
krb5kdc: starting...
W20260812 00:26:36.105705 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.002s sys 0.061s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:36 dist-test-slave-njxd krb5kdc[11233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494396, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:26:36.492834 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43287
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43287
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:36.864094 11248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:36.864502 11248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:36.864677 11248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:36.872251 11248 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:36.872432 11248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:36.872553 11248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:36.872666 11248 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:36.872761 11248 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:36.883065 11248 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43287
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:36.884550 11248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:36.886380 11248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:36.898792 11253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:36.900694 11257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:36.900698 11254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:36.901381 11248 server_base.cc:1034] running on GCE node
I20260812 00:26:36.902290 11248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:36.903942 11248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:36.905156 11248 hybrid_clock.cc:648] HybridClock initialized: now 1786494396905106 us; error 43 us; skew 500 ppm
I20260812 00:26:36.905741 11248 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:36 dist-test-slave-njxd krb5kdc[11233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494396, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:36.909056 11248 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:26:36.910916 11248 webserver.cc:460] Webserver started at http://127.0.0.1:35995/ using document root <none> and password file <none>
I20260812 00:26:36.911780 11248 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:36.911926 11248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:36.912277 11248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:36.915726 11248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "a14a7cdb6de341668a941b1a8d312e3c"
format_stamp: "Formatted at 2026-08-12 00:26:36 on dist-test-slave-njxd"
server_key: "e08dbbed4652ae89a9491e622f496a48"
server_key_iv: "6be4924c28a80008bc4f22456afbe551"
server_key_version: "encryptionkey@0"
I20260812 00:26:36.916610 11248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "a14a7cdb6de341668a941b1a8d312e3c"
format_stamp: "Formatted at 2026-08-12 00:26:36 on dist-test-slave-njxd"
server_key: "e08dbbed4652ae89a9491e622f496a48"
server_key_iv: "6be4924c28a80008bc4f22456afbe551"
server_key_version: "encryptionkey@0"
I20260812 00:26:36.922349 11248 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 00:26:36.926126 11266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:36.927783 11248 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260812 00:26:36.927990 11248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "a14a7cdb6de341668a941b1a8d312e3c"
format_stamp: "Formatted at 2026-08-12 00:26:36 on dist-test-slave-njxd"
server_key: "e08dbbed4652ae89a9491e622f496a48"
server_key_iv: "6be4924c28a80008bc4f22456afbe551"
server_key_version: "encryptionkey@0"
I20260812 00:26:36.928215 11248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:36.934403 11248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:36.939177 11248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:36.939512 11248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:36.958791 11248 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43287
I20260812 00:26:36.958832 11324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43287 every 8 connection(s)
I20260812 00:26:36.960417 11248 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:36.961509 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 11248
I20260812 00:26:36.961756 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:36.962196 19087 external_mini_cluster.cc:1428] Setting key caa791c76c7884a38363344805634062
I20260812 00:26:36.965276 11325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:36.971774 11329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:36.964215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:39885 (local address 127.0.0.1:43287)
0812 00:26:36.965094 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:36.965110 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:36.965163 (+ 53us) server_negotiation.cc:407] Connection header received
0812 00:26:36.967583 (+ 2420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:36.967613 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:36.968081 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:36.968569 (+ 488us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:36.969645 (+ 1076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:36.969654 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:36.969671 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:36.969689 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:36.969797 (+ 108us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:36.969832 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:36.970082 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:36.970230 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 00:26:36.970442 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":350,"threads_started":1}
I20260812 00:26:36.975992 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:36.979468 11325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c: Bootstrap starting.
I20260812 00:26:36.983212 11325 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:36.983983 11329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:36.981137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:32995 (local address 127.0.0.1:43287)
0812 00:26:36.981356 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:36.981364 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:36.981799 (+ 435us) server_negotiation.cc:407] Connection header received
0812 00:26:36.982037 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:36.982041 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:36.982095 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:36.982201 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:36.983226 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:36.983231 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:36.983236 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:36.983257 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:36.983308 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:36.983325 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:36.983456 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:36.983624 (+ 168us) server_negotiation.cc:299] Negotiation successful
0812 00:26:36.983681 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 00:26:36.984747 11325 log.cc:824] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:36.987861 11325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c: No bootstrap required, opened a new log
I20260812 00:26:36.996037 11325 raft_consensus.cc:348] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a14a7cdb6de341668a941b1a8d312e3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43287 } }
I20260812 00:26:36.996739 11325 raft_consensus.cc:374] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:36.996879 11325 raft_consensus.cc:729] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a14a7cdb6de341668a941b1a8d312e3c, State: Initialized, Role: FOLLOWER
I20260812 00:26:36.997635 11325 consensus_queue.cc:260] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a14a7cdb6de341668a941b1a8d312e3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43287 } }
I20260812 00:26:36.997886 11325 raft_consensus.cc:388] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:36.998025 11325 raft_consensus.cc:482] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:36.998219 11325 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:37.000463 11325 raft_consensus.cc:504] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a14a7cdb6de341668a941b1a8d312e3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43287 } }
I20260812 00:26:37.001005 11325 leader_election.cc:302] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a14a7cdb6de341668a941b1a8d312e3c; no voters:
I20260812 00:26:37.001694 11325 leader_election.cc:288] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:37.001832 11336 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:37.002553 11336 raft_consensus.cc:686] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [term 1 LEADER]: Becoming Leader. State: Replica: a14a7cdb6de341668a941b1a8d312e3c, State: Running, Role: LEADER
I20260812 00:26:37.003122 11336 consensus_queue.cc:237] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a14a7cdb6de341668a941b1a8d312e3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43287 } }
I20260812 00:26:37.003893 11325 sys_catalog.cc:564] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:37.006558 11338 sys_catalog.cc:455] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a14a7cdb6de341668a941b1a8d312e3c. Latest consensus state: current_term: 1 leader_uuid: "a14a7cdb6de341668a941b1a8d312e3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a14a7cdb6de341668a941b1a8d312e3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43287 } } }
I20260812 00:26:37.006978 11338 sys_catalog.cc:458] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:37.007493 11337 sys_catalog.cc:455] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a14a7cdb6de341668a941b1a8d312e3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a14a7cdb6de341668a941b1a8d312e3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43287 } } }
I20260812 00:26:37.007997 11337 sys_catalog.cc:458] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:37.009737 11345 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:37.015679 11345 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:37.025439 11345 catalog_manager.cc:1347] Generated new cluster ID: a210217470b047d9b270b44785fd64b1
I20260812 00:26:37.025622 11345 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:37.040917 11345 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:37.041538 11345 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:37.061024 11345 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a14a7cdb6de341668a941b1a8d312e3c: Generated new TSK 0
I20260812 00:26:37.062273 11345 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:37.071794 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 11248
W20260812 00:26:37.073174 11320 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.106:39885
W20260812 00:26:37.074448 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 11248: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:26:37.074643 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 11248
2026-08-12T00:26:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2195 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:37 dist-test-slave-njxd krb5kdc[11359](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:37 dist-test-slave-njxd krb5kdc[11359](info): set up 2 sockets
Aug 12 00:26:37 dist-test-slave-njxd krb5kdc[11359](info): commencing operation
krb5kdc: starting...
W20260812 00:26:38.309113 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.001s sys 0.063s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:38 dist-test-slave-njxd krb5kdc[11359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494398, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:26:38.708410 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:37627
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:46075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:37627
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:39.096954 11373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:39.097280 11373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:39.097463 11373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:39.104971 11373 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:39.105108 11373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:39.105163 11373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:39.105221 11373 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:39.105257 11373 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:39.115934 11373 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:46075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:37627
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:37627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:39.117440 11373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:39.118965 11373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:39.131620 11379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:39.131554 11378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:39.131654 11381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:39.132637 11373 server_base.cc:1034] running on GCE node
I20260812 00:26:39.133536 11373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:39.135094 11373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:39.136355 11373 hybrid_clock.cc:648] HybridClock initialized: now 1786494399136309 us; error 63 us; skew 500 ppm
I20260812 00:26:39.136751 11373 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:39 dist-test-slave-njxd krb5kdc[11359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494399, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:39.140203 11373 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:26:39.141887 11373 webserver.cc:460] Webserver started at http://127.18.163.254:39461/ using document root <none> and password file <none>
I20260812 00:26:39.142668 11373 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:39.142833 11373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:39.143182 11373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:39.146566 11373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "196f04a4c4fe44be9775d085ff980b8d"
format_stamp: "Formatted at 2026-08-12 00:26:39 on dist-test-slave-njxd"
server_key: "df8c9416169b2a4c28373c3be5c195f6"
server_key_iv: "41b36d00f5ab699cb121e31cca2726ce"
server_key_version: "encryptionkey@0"
I20260812 00:26:39.147455 11373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "196f04a4c4fe44be9775d085ff980b8d"
format_stamp: "Formatted at 2026-08-12 00:26:39 on dist-test-slave-njxd"
server_key: "df8c9416169b2a4c28373c3be5c195f6"
server_key_iv: "41b36d00f5ab699cb121e31cca2726ce"
server_key_version: "encryptionkey@0"
I20260812 00:26:39.153723 11373 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:26:39.157929 11388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:39.159547 11373 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:26:39.159796 11373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "196f04a4c4fe44be9775d085ff980b8d"
format_stamp: "Formatted at 2026-08-12 00:26:39 on dist-test-slave-njxd"
server_key: "df8c9416169b2a4c28373c3be5c195f6"
server_key_iv: "41b36d00f5ab699cb121e31cca2726ce"
server_key_version: "encryptionkey@0"
I20260812 00:26:39.160040 11373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:39.179397 11373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:39.184306 11373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:39.184645 11373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:39.205343 11373 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:37627
I20260812 00:26:39.205371 11448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:37627 every 8 connection(s)
I20260812 00:26:39.206961 11373 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:39.210071 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 11373
I20260812 00:26:39.210299 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:39.210814 19087 external_mini_cluster.cc:1428] Setting key f5a6be3c3cb10066021d1611cfebbfdc
I20260812 00:26:39.211447 11449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:39.225672 11449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d: Bootstrap starting.
Aug 12 00:26:39 dist-test-slave-njxd krb5kdc[11359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494398, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:26:39.230439 11449 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:39.232148 11449 log.cc:824] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:39.236456 11449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d: No bootstrap required, opened a new log
I20260812 00:26:39.237834 11452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:39.212883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53625 (local address 127.18.163.254:37627)
0812 00:26:39.213780 (+ 897us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:39.213793 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:39.213844 (+ 51us) server_negotiation.cc:407] Connection header received
0812 00:26:39.215503 (+ 1659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:39.215529 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:39.216015 (+ 486us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:39.216488 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:39.218407 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:39.219899 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:39.221325 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:39.222221 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:39.222456 (+ 235us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:39.227298 (+ 4842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:39.227313 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:39.227343 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:39.227411 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:39.231861 (+ 4450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:39.233158 (+ 1297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:39.233166 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:39.233174 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:39.233407 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:39.234101 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:39.234107 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:39.234110 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:39.234932 (+ 822us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:39.235312 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:39.235866 (+ 554us) server_negotiation.cc:299] Negotiation successful
0812 00:26:39.236296 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":373,"threads_started":1}
I20260812 00:26:39.242482 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:39.245968 11449 raft_consensus.cc:348] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "196f04a4c4fe44be9775d085ff980b8d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37627 } }
I20260812 00:26:39.246454 11449 raft_consensus.cc:374] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:39.246573 11449 raft_consensus.cc:729] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196f04a4c4fe44be9775d085ff980b8d, State: Initialized, Role: FOLLOWER
I20260812 00:26:39.247236 11449 consensus_queue.cc:260] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "196f04a4c4fe44be9775d085ff980b8d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37627 } }
I20260812 00:26:39.247645 11449 raft_consensus.cc:388] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:39.247830 11449 raft_consensus.cc:482] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:39.248045 11449 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:39.251539 11449 raft_consensus.cc:504] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "196f04a4c4fe44be9775d085ff980b8d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37627 } }
I20260812 00:26:39.252272 11449 leader_election.cc:302] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 196f04a4c4fe44be9775d085ff980b8d; no voters:
I20260812 00:26:39.253026 11449 leader_election.cc:288] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:39.253154 11459 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:39.254827 11459 raft_consensus.cc:686] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [term 1 LEADER]: Becoming Leader. State: Replica: 196f04a4c4fe44be9775d085ff980b8d, State: Running, Role: LEADER
I20260812 00:26:39.255519 11459 consensus_queue.cc:237] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "196f04a4c4fe44be9775d085ff980b8d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37627 } }
I20260812 00:26:39.255832 11449 sys_catalog.cc:564] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:39.258570 11461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 196f04a4c4fe44be9775d085ff980b8d. Latest consensus state: current_term: 1 leader_uuid: "196f04a4c4fe44be9775d085ff980b8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "196f04a4c4fe44be9775d085ff980b8d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37627 } } }
I20260812 00:26:39.259127 11461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:39.258575 11460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "196f04a4c4fe44be9775d085ff980b8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "196f04a4c4fe44be9775d085ff980b8d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 37627 } } }
I20260812 00:26:39.259769 11460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:39.272225 11452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:39.247426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34963 (local address 127.18.163.254:37627)
0812 00:26:39.247664 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:39.247673 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:39.248370 (+ 697us) server_negotiation.cc:407] Connection header received
0812 00:26:39.248571 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:39.248575 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:39.248645 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:39.248733 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:39.250804 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:39.251619 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:39.253613 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:39.254582 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:39.254735 (+ 153us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:39.258887 (+ 4152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:39.258897 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:39.258909 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:39.258982 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:39.265344 (+ 6362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:39.267518 (+ 2174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:39.267530 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:39.267537 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:39.267930 (+ 393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:39.268919 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:39.268930 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:39.268936 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:39.269553 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:39.270021 (+ 468us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:39.271039 (+ 1018us) server_negotiation.cc:299] Negotiation successful
0812 00:26:39.271471 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:26:39.275786 11467 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:39.281061 11467 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:39.282681 11478 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 00:26:39.291230 11467 catalog_manager.cc:1347] Generated new cluster ID: a6b8976f2b8e44259a42d0526a04e8b9
I20260812 00:26:39.291394 11467 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:39.305819 11467 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:39.307502 11467 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:39.317078 11467 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 196f04a4c4fe44be9775d085ff980b8d: Generated new TSK 0
I20260812 00:26:39.318352 11467 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:39.332513 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 11373
I20260812 00:26:39.334570 11444 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:39.429597 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 11373
W20260812 00:26:39.452638 11357 connection.cc:535] client connection to 127.18.163.254:37627 recv error: Network error: failed to read from TLS socket (remote: 127.18.163.254:37627): Connection reset by peer (error 104)
2026-08-12T00:26:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2354 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:39 dist-test-slave-njxd krb5kdc[11483](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:39 dist-test-slave-njxd krb5kdc[11483](info): set up 2 sockets
Aug 12 00:26:39 dist-test-slave-njxd krb5kdc[11483](info): commencing operation
krb5kdc: starting...
W20260812 00:26:40.653324 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.000s sys 0.065s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:40 dist-test-slave-njxd krb5kdc[11483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494400, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:26:41.055516 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:39379
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:34769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:39379
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:41.454406 11499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:41.454759 11499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:41.454859 11499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:41.462500 11499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:41.462630 11499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:41.462729 11499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:41.462826 11499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:41.462890 11499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:41.473353 11499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:34769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:39379
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:39379
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:41.474851 11499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:41.476248 11499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:41.488953 11506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:41.488925 11505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:41.489610 11508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:41.490342 11499 server_base.cc:1034] running on GCE node
I20260812 00:26:41.491142 11499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:41.492707 11499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:41.493918 11499 hybrid_clock.cc:648] HybridClock initialized: now 1786494401493879 us; error 35 us; skew 500 ppm
I20260812 00:26:41.494257 11499 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:41 dist-test-slave-njxd krb5kdc[11483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494401, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:41.497643 11499 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:26:41.499339 11499 webserver.cc:460] Webserver started at http://127.18.163.254:33281/ using document root <none> and password file <none>
I20260812 00:26:41.500388 11499 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:41.500535 11499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:41.500895 11499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:41.504225 11499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "cc11ba68f19c421e915e028da763490b"
format_stamp: "Formatted at 2026-08-12 00:26:41 on dist-test-slave-njxd"
server_key: "6d0dbfbf687a44dd3daaadd8f13e9bc9"
server_key_iv: "48e6f7f663c20fa277dc4973e0f79954"
server_key_version: "encryptionkey@0"
I20260812 00:26:41.505044 11499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "cc11ba68f19c421e915e028da763490b"
format_stamp: "Formatted at 2026-08-12 00:26:41 on dist-test-slave-njxd"
server_key: "6d0dbfbf687a44dd3daaadd8f13e9bc9"
server_key_iv: "48e6f7f663c20fa277dc4973e0f79954"
server_key_version: "encryptionkey@0"
I20260812 00:26:41.510644 11499 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260812 00:26:41.514513 11521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:41.516052 11499 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:26:41.516270 11499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "cc11ba68f19c421e915e028da763490b"
format_stamp: "Formatted at 2026-08-12 00:26:41 on dist-test-slave-njxd"
server_key: "6d0dbfbf687a44dd3daaadd8f13e9bc9"
server_key_iv: "48e6f7f663c20fa277dc4973e0f79954"
server_key_version: "encryptionkey@0"
I20260812 00:26:41.516472 11499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:41.535228 11499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:41.540236 11499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:41.540585 11499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:41.561728 11499 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:39379
I20260812 00:26:41.561700 11576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:39379 every 8 connection(s)
I20260812 00:26:41.563335 11499 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:41.565052 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 11499
I20260812 00:26:41.565272 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:41.565915 19087 external_mini_cluster.cc:1428] Setting key 4727959542506ef7178087f2db14b1e3
I20260812 00:26:41.568365 11577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:41.581167 11581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:41.567869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52159 (local address 127.18.163.254:39379)
0812 00:26:41.568767 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:41.568779 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:41.568823 (+ 44us) server_negotiation.cc:407] Connection header received
0812 00:26:41.570639 (+ 1816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:41.570673 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:41.571134 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:41.571615 (+ 481us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:41.572241 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:41.573848 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:41.575858 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:41.576601 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:41.576756 (+ 155us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:41.578405 (+ 1649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:41.578413 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:41.578438 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:41.579110 (+ 672us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:41.579209 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:41.579247 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:41.579391 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:41.579779 (+ 388us) server_negotiation.cc:299] Negotiation successful
0812 00:26:41.580021 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":429,"threads_started":1}
I20260812 00:26:41.582278 11577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b: Bootstrap starting.
I20260812 00:26:41.585675 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:41.585911 11577 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:41.587329 11577 log.cc:824] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:41.591414 11577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b: No bootstrap required, opened a new log
I20260812 00:26:41.598735 11581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:41.591421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60823 (local address 127.18.163.254:39379)
0812 00:26:41.591632 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:41.591647 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:41.592106 (+ 459us) server_negotiation.cc:407] Connection header received
0812 00:26:41.592296 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:41.592305 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:41.592401 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:41.592544 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:41.593029 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:41.594304 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:41.595752 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:41.596453 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:41.596587 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:41.597853 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:41.597860 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:41.597866 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:41.597898 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:41.597955 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:41.597982 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:41.598111 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:41.598288 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 00:26:41.598362 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 00:26:41.601671 11577 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc11ba68f19c421e915e028da763490b" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 39379 } }
I20260812 00:26:41.602151 11577 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:41.602279 11577 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc11ba68f19c421e915e028da763490b, State: Initialized, Role: FOLLOWER
I20260812 00:26:41.602905 11577 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc11ba68f19c421e915e028da763490b" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 39379 } }
I20260812 00:26:41.603173 11577 raft_consensus.cc:388] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:41.603338 11577 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:41.603529 11577 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:41.606073 11577 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc11ba68f19c421e915e028da763490b" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 39379 } }
I20260812 00:26:41.606662 11577 leader_election.cc:302] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc11ba68f19c421e915e028da763490b; no voters:
I20260812 00:26:41.607353 11577 leader_election.cc:288] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:41.607525 11588 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:41.608431 11588 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [term 1 LEADER]: Becoming Leader. State: Replica: cc11ba68f19c421e915e028da763490b, State: Running, Role: LEADER
I20260812 00:26:41.609444 11588 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc11ba68f19c421e915e028da763490b" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 39379 } }
I20260812 00:26:41.609990 11577 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:41.612638 11589 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc11ba68f19c421e915e028da763490b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc11ba68f19c421e915e028da763490b" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 39379 } } }
I20260812 00:26:41.612823 11590 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc11ba68f19c421e915e028da763490b. Latest consensus state: current_term: 1 leader_uuid: "cc11ba68f19c421e915e028da763490b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc11ba68f19c421e915e028da763490b" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 39379 } } }
I20260812 00:26:41.613143 11589 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:41.613143 11590 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:41.614219 11598 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:41.621541 11598 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:41.632279 11598 catalog_manager.cc:1347] Generated new cluster ID: 6810cbb59867488a9721b652626577e3
I20260812 00:26:41.632452 11598 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:41.660243 11598 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:41.661830 11598 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:41.672824 11598 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cc11ba68f19c421e915e028da763490b: Generated new TSK 0
I20260812 00:26:41.673810 11598 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:41.682530 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 11499
W20260812 00:26:41.683888 11572 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:52159
W20260812 00:26:41.684765 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 11499: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:26:41.684933 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 11499
W20260812 00:26:41.709317 11481 connection.cc:535] client connection to 127.18.163.254:39379 recv error: Network error: failed to read from TLS socket (remote: 127.18.163.254:39379): Connection reset by peer (error 104)
2026-08-12T00:26:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2256 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:41 dist-test-slave-njxd krb5kdc[11611](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:41 dist-test-slave-njxd krb5kdc[11611](info): set up 2 sockets
Aug 12 00:26:41 dist-test-slave-njxd krb5kdc[11611](info): commencing operation
krb5kdc: starting...
W20260812 00:26:42.914887 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.000s sys 0.063s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:43 dist-test-slave-njxd krb5kdc[11611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:26:43.310035 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:46783
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:42817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:46783
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:43.678982 11627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:43.679322 11627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:43.679509 11627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:43.687110 11627 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:43.687242 11627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:43.687366 11627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:43.687500 11627 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:43.687563 11627 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:43.698236 11627 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:42817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:46783
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:46783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:43.699728 11627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:43.701208 11627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:43.713927 11635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:43.713887 11637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:43.713953 11634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:43.714756 11627 server_base.cc:1034] running on GCE node
I20260812 00:26:43.715616 11627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:43.717103 11627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:43.718328 11627 hybrid_clock.cc:648] HybridClock initialized: now 1786494403718268 us; error 46 us; skew 500 ppm
I20260812 00:26:43.718743 11627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:43 dist-test-slave-njxd krb5kdc[11611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494403, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:43.722421 11627 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:26:43.724105 11627 webserver.cc:460] Webserver started at http://127.18.163.254:38823/ using document root <none> and password file <none>
I20260812 00:26:43.724922 11627 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:43.725095 11627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:43.725441 11627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:43.728924 11627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "f1dad5d4d1b7491abccf8a94c7c7b6e2"
format_stamp: "Formatted at 2026-08-12 00:26:43 on dist-test-slave-njxd"
server_key: "6903ff41d88bdc1a3044bcb5404f4a11"
server_key_iv: "d488215c1a4424af2a74d5caf16a1cf8"
server_key_version: "encryptionkey@0"
I20260812 00:26:43.729894 11627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "f1dad5d4d1b7491abccf8a94c7c7b6e2"
format_stamp: "Formatted at 2026-08-12 00:26:43 on dist-test-slave-njxd"
server_key: "6903ff41d88bdc1a3044bcb5404f4a11"
server_key_iv: "d488215c1a4424af2a74d5caf16a1cf8"
server_key_version: "encryptionkey@0"
I20260812 00:26:43.735908 11627 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:26:43.740094 11645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:43.741758 11627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 00:26:43.741990 11627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "f1dad5d4d1b7491abccf8a94c7c7b6e2"
format_stamp: "Formatted at 2026-08-12 00:26:43 on dist-test-slave-njxd"
server_key: "6903ff41d88bdc1a3044bcb5404f4a11"
server_key_iv: "d488215c1a4424af2a74d5caf16a1cf8"
server_key_version: "encryptionkey@0"
I20260812 00:26:43.742241 11627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:43.748790 11627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:43.753724 11627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:43.754067 11627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:43.775110 11627 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:46783
I20260812 00:26:43.775156 11704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:46783 every 8 connection(s)
I20260812 00:26:43.776696 11627 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:43.778983 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 11627
I20260812 00:26:43.779214 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:43.779687 19087 external_mini_cluster.cc:1428] Setting key 4329d56bf2a1f6301a6e969f6a65603b
I20260812 00:26:43.781292 11705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:43.788503 11708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:43.781764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38757 (local address 127.18.163.254:46783)
0812 00:26:43.782680 (+ 916us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:43.782692 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:43.782738 (+ 46us) server_negotiation.cc:407] Connection header received
0812 00:26:43.784416 (+ 1678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:43.784442 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:43.784870 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:43.785375 (+ 505us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:43.786639 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:43.786646 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:43.786661 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:43.786676 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:43.786756 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:43.786776 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:43.787071 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:43.787242 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 00:26:43.787456 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":406,"threads_started":1}
I20260812 00:26:43.792677 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:43.794732 11705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2: Bootstrap starting.
I20260812 00:26:43.798691 11705 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:43.800264 11705 log.cc:824] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:43.800930 11708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:43.797751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48659 (local address 127.18.163.254:46783)
0812 00:26:43.797988 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:43.797994 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:43.798363 (+ 369us) server_negotiation.cc:407] Connection header received
0812 00:26:43.798654 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:43.798659 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:43.798720 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:43.798870 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:43.800048 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:43.800054 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:43.800058 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:43.800077 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:43.800125 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:43.800154 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:43.800264 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:43.800475 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 00:26:43.800568 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260812 00:26:43.804072 11705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2: No bootstrap required, opened a new log
I20260812 00:26:43.812426 11705 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1dad5d4d1b7491abccf8a94c7c7b6e2" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46783 } }
I20260812 00:26:43.812867 11705 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:43.813045 11705 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1dad5d4d1b7491abccf8a94c7c7b6e2, State: Initialized, Role: FOLLOWER
I20260812 00:26:43.813854 11705 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1dad5d4d1b7491abccf8a94c7c7b6e2" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46783 } }
I20260812 00:26:43.814121 11705 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:43.814236 11705 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:43.814383 11705 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:43.816700 11705 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1dad5d4d1b7491abccf8a94c7c7b6e2" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46783 } }
I20260812 00:26:43.817229 11705 leader_election.cc:302] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1dad5d4d1b7491abccf8a94c7c7b6e2; no voters:
I20260812 00:26:43.817965 11705 leader_election.cc:288] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:43.818166 11716 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:43.819499 11716 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [term 1 LEADER]: Becoming Leader. State: Replica: f1dad5d4d1b7491abccf8a94c7c7b6e2, State: Running, Role: LEADER
I20260812 00:26:43.820111 11705 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:43.820150 11716 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1dad5d4d1b7491abccf8a94c7c7b6e2" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46783 } }
I20260812 00:26:43.823886 11718 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1dad5d4d1b7491abccf8a94c7c7b6e2. Latest consensus state: current_term: 1 leader_uuid: "f1dad5d4d1b7491abccf8a94c7c7b6e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1dad5d4d1b7491abccf8a94c7c7b6e2" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46783 } } }
I20260812 00:26:43.824368 11718 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:43.824977 11717 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1dad5d4d1b7491abccf8a94c7c7b6e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1dad5d4d1b7491abccf8a94c7c7b6e2" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 46783 } } }
I20260812 00:26:43.826174 11717 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:43.835988 11726 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:43.840943 11726 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:43.851048 11726 catalog_manager.cc:1347] Generated new cluster ID: 79656b7eec7d4f51b6684207f3e79878
I20260812 00:26:43.851207 11726 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:43.873598 11726 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:43.874121 11726 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:43.889115 11726 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1dad5d4d1b7491abccf8a94c7c7b6e2: Generated new TSK 0
I20260812 00:26:43.890162 11726 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:43.896368 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 11627
W20260812 00:26:43.897663 11699 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:38757
W20260812 00:26:43.898409 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 11627: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:26:43.898572 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 11627
2026-08-12T00:26:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2213 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:44 dist-test-slave-njxd krb5kdc[11740](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:44 dist-test-slave-njxd krb5kdc[11740](info): set up 2 sockets
Aug 12 00:26:44 dist-test-slave-njxd krb5kdc[11740](info): commencing operation
krb5kdc: starting...
W20260812 00:26:45.124356 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.000s sys 0.063s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:45 dist-test-slave-njxd krb5kdc[11740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494405, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:26:45.525132 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:35231
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:46155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:35231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:45.901405 11756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:45.901866 11756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:45.902052 11756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:45.909865 11756 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:45.910027 11756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:45.910136 11756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:45.910244 11756 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:45.910331 11756 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:45.921100 11756 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:46155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:35231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:35231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:45.923069 11756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:45.925235 11756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:45.937803 11761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:45.938370 11762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:45.940294 11764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:45.940912 11756 server_base.cc:1034] running on GCE node
I20260812 00:26:45.942093 11756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:45.944226 11756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:45.945509 11756 hybrid_clock.cc:648] HybridClock initialized: now 1786494405945458 us; error 56 us; skew 500 ppm
I20260812 00:26:45.946039 11756 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:45 dist-test-slave-njxd krb5kdc[11740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494405, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:45.949903 11756 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:26:45.951749 11756 webserver.cc:460] Webserver started at http://127.18.163.254:37127/ using document root <none> and password file <none>
I20260812 00:26:45.952627 11756 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:45.952808 11756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:45.953188 11756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:45.956835 11756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "2d651614d03c4a539b52f55e299ec738"
format_stamp: "Formatted at 2026-08-12 00:26:45 on dist-test-slave-njxd"
server_key: "0cf96a06228b9f6728552e9f0ad5aa46"
server_key_iv: "2637a978dae12dc951a12baa1b140276"
server_key_version: "encryptionkey@0"
I20260812 00:26:45.957880 11756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "2d651614d03c4a539b52f55e299ec738"
format_stamp: "Formatted at 2026-08-12 00:26:45 on dist-test-slave-njxd"
server_key: "0cf96a06228b9f6728552e9f0ad5aa46"
server_key_iv: "2637a978dae12dc951a12baa1b140276"
server_key_version: "encryptionkey@0"
I20260812 00:26:45.964025 11756 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s
I20260812 00:26:45.968451 11771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:45.970281 11756 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:26:45.970526 11756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "2d651614d03c4a539b52f55e299ec738"
format_stamp: "Formatted at 2026-08-12 00:26:45 on dist-test-slave-njxd"
server_key: "0cf96a06228b9f6728552e9f0ad5aa46"
server_key_iv: "2637a978dae12dc951a12baa1b140276"
server_key_version: "encryptionkey@0"
I20260812 00:26:45.970785 11756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:45.992014 11756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:45.996752 11756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:45.997092 11756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:46.018080 11756 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:35231
I20260812 00:26:46.018086 11832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:35231 every 8 connection(s)
I20260812 00:26:46.019781 11756 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:46.024034 11833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:46.025768 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 11756
I20260812 00:26:46.025975 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:46.026424 19087 external_mini_cluster.cc:1428] Setting key 26d3402c08a1b54d027f04b520ff806c
I20260812 00:26:46.040199 11833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738: Bootstrap starting.
Aug 12 00:26:46 dist-test-slave-njxd krb5kdc[11740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494405, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:26:46.044082 11833 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:46.045750 11833 log.cc:824] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:46.049423 11833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738: No bootstrap required, opened a new log
I20260812 00:26:46.053275 11836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:46.028566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60087 (local address 127.18.163.254:35231)
0812 00:26:46.029532 (+ 966us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:46.029554 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:46.029636 (+ 82us) server_negotiation.cc:407] Connection header received
0812 00:26:46.031591 (+ 1955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:46.031630 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:46.032298 (+ 668us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:46.032819 (+ 521us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:46.034400 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:46.036587 (+ 2187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:46.038038 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:46.039220 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:46.039420 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:46.044028 (+ 4608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:46.044041 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:46.044075 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:46.044142 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:46.048295 (+ 4153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:46.049269 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:46.049276 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:46.049283 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:46.049496 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:46.050022 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:46.050026 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:46.050028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:46.050646 (+ 618us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:46.050990 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:46.051574 (+ 584us) server_negotiation.cc:299] Negotiation successful
0812 00:26:46.052080 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":685,"thread_start_us":416,"threads_started":1}
I20260812 00:26:46.057482 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:46.058378 11833 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d651614d03c4a539b52f55e299ec738" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35231 } }
I20260812 00:26:46.058817 11833 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:46.058934 11833 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d651614d03c4a539b52f55e299ec738, State: Initialized, Role: FOLLOWER
I20260812 00:26:46.059531 11833 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d651614d03c4a539b52f55e299ec738" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35231 } }
I20260812 00:26:46.059824 11833 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:46.059978 11833 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:46.060156 11833 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:46.062834 11833 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d651614d03c4a539b52f55e299ec738" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35231 } }
I20260812 00:26:46.063561 11833 leader_election.cc:302] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d651614d03c4a539b52f55e299ec738; no voters:
I20260812 00:26:46.064277 11833 leader_election.cc:288] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:46.064435 11844 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:46.065670 11844 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [term 1 LEADER]: Becoming Leader. State: Replica: 2d651614d03c4a539b52f55e299ec738, State: Running, Role: LEADER
I20260812 00:26:46.066413 11844 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d651614d03c4a539b52f55e299ec738" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35231 } }
I20260812 00:26:46.066846 11833 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:46.069763 11845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d651614d03c4a539b52f55e299ec738" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d651614d03c4a539b52f55e299ec738" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35231 } } }
I20260812 00:26:46.070207 11845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:46.070824 11846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d651614d03c4a539b52f55e299ec738. Latest consensus state: current_term: 1 leader_uuid: "2d651614d03c4a539b52f55e299ec738" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d651614d03c4a539b52f55e299ec738" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35231 } } }
I20260812 00:26:46.071178 11846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:46.082526 11850 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:46.087559 11836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:46.062713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47103 (local address 127.18.163.254:35231)
0812 00:26:46.062995 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:46.063002 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:46.063419 (+ 417us) server_negotiation.cc:407] Connection header received
0812 00:26:46.063616 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:46.063620 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:46.063695 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:46.063821 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:46.066274 (+ 2453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:46.067388 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:46.069429 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:46.070323 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:46.070469 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:46.075097 (+ 4628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:46.075109 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:46.075117 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:46.075197 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:46.083782 (+ 8585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:46.084879 (+ 1097us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:46.084885 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:46.084889 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:46.085053 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:46.085622 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:46.085627 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:46.085631 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:46.086204 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:46.086497 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:46.086888 (+ 391us) server_negotiation.cc:299] Negotiation successful
0812 00:26:46.087148 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 00:26:46.088886 11850 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:46.099483 11850 catalog_manager.cc:1347] Generated new cluster ID: 55046da057b146f7bd3156226c98cf55
I20260812 00:26:46.099627 11850 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:46.115550 11850 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:46.117764 11850 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:46.128412 11850 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d651614d03c4a539b52f55e299ec738: Generated new TSK 0
I20260812 00:26:46.129443 11850 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:46.137408 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 11756
I20260812 00:26:46.138686 11828 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:46.232466 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 11756
2026-08-12T00:26:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2331 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:46 dist-test-slave-njxd krb5kdc[11869](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:46 dist-test-slave-njxd krb5kdc[11869](info): set up 2 sockets
Aug 12 00:26:46 dist-test-slave-njxd krb5kdc[11869](info): commencing operation
krb5kdc: starting...
W20260812 00:26:47.465117 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.005s sys 0.060s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:47 dist-test-slave-njxd krb5kdc[11869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:26:47.861001 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:35531
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:37103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:35531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:48.236004 11882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:48.236330 11882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:48.236514 11882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:48.244071 11882 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:48.244228 11882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:48.244321 11882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:48.244428 11882 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:48.244493 11882 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:48.255218 11882 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:37103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:35531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:35531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:48.256675 11882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:48.258145 11882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:48.271289 11888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:48.271240 11892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:48.271330 11889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:48.272276 11882 server_base.cc:1034] running on GCE node
I20260812 00:26:48.273208 11882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:48.274857 11882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:48.276084 11882 hybrid_clock.cc:648] HybridClock initialized: now 1786494408276041 us; error 39 us; skew 500 ppm
I20260812 00:26:48.276439 11882 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:48 dist-test-slave-njxd krb5kdc[11869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494408, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:48.279953 11882 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:26:48.281790 11882 webserver.cc:460] Webserver started at http://127.18.163.254:34095/ using document root <none> and password file <none>
I20260812 00:26:48.282570 11882 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:48.282714 11882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:48.283070 11882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:48.286418 11882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "9d53c4a0ffc649bd96939619a87a3395"
format_stamp: "Formatted at 2026-08-12 00:26:48 on dist-test-slave-njxd"
server_key: "48756f912593894964801595d0d309bb"
server_key_iv: "bfe68bcd3cf54b9066f1d46072423a34"
server_key_version: "encryptionkey@0"
I20260812 00:26:48.287276 11882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "9d53c4a0ffc649bd96939619a87a3395"
format_stamp: "Formatted at 2026-08-12 00:26:48 on dist-test-slave-njxd"
server_key: "48756f912593894964801595d0d309bb"
server_key_iv: "bfe68bcd3cf54b9066f1d46072423a34"
server_key_version: "encryptionkey@0"
I20260812 00:26:48.292999 11882 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 00:26:48.296886 11900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:48.298435 11882 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:26:48.298642 11882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "9d53c4a0ffc649bd96939619a87a3395"
format_stamp: "Formatted at 2026-08-12 00:26:48 on dist-test-slave-njxd"
server_key: "48756f912593894964801595d0d309bb"
server_key_iv: "bfe68bcd3cf54b9066f1d46072423a34"
server_key_version: "encryptionkey@0"
I20260812 00:26:48.298877 11882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:48.335613 11882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:48.340014 11882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:48.340359 11882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:48.360981 11882 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:35531
I20260812 00:26:48.361001 11953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:35531 every 8 connection(s)
I20260812 00:26:48.362610 11882 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:48.366771 11954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:48.371378 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 11882
I20260812 00:26:48.371603 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:48.372187 19087 external_mini_cluster.cc:1428] Setting key 625f45bb0fb9a3634eaa3fbffaf92391
I20260812 00:26:48.380990 11954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395: Bootstrap starting.
I20260812 00:26:48.384768 11954 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:48.386109 11954 log.cc:824] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:48.386924 11957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:48.374389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54879 (local address 127.18.163.254:35531)
0812 00:26:48.375327 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:48.375340 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:48.375385 (+ 45us) server_negotiation.cc:407] Connection header received
0812 00:26:48.377120 (+ 1735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:48.377149 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:48.377737 (+ 588us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:48.378208 (+ 471us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:48.378887 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:48.380298 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:48.381850 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:48.382607 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:48.382833 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:48.384136 (+ 1303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:48.384143 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:48.384159 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:48.384752 (+ 593us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:48.384842 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:48.384896 (+ 54us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:48.385048 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:48.385317 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 00:26:48.385662 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":713,"thread_start_us":388,"threads_started":1}
I20260812 00:26:48.389724 11954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395: No bootstrap required, opened a new log
I20260812 00:26:48.391075 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:48.398746 11954 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d53c4a0ffc649bd96939619a87a3395" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35531 } }
I20260812 00:26:48.399241 11954 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:48.399361 11954 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d53c4a0ffc649bd96939619a87a3395, State: Initialized, Role: FOLLOWER
I20260812 00:26:48.400157 11954 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d53c4a0ffc649bd96939619a87a3395" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35531 } }
I20260812 00:26:48.400499 11954 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:48.400676 11954 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:48.400857 11954 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:48.402437 11957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:48.395616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44323 (local address 127.18.163.254:35531)
0812 00:26:48.395800 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:48.395825 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:48.396309 (+ 484us) server_negotiation.cc:407] Connection header received
0812 00:26:48.396542 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:48.396546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:48.396619 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:48.396741 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:48.397268 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:48.398103 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:48.399573 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:48.400253 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:48.400411 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:48.401601 (+ 1190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:48.401608 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:48.401613 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:48.401637 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:48.401689 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:48.401714 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:48.401829 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:48.401934 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 00:26:48.402054 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 00:26:48.404536 11954 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d53c4a0ffc649bd96939619a87a3395" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35531 } }
I20260812 00:26:48.405047 11954 leader_election.cc:302] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d53c4a0ffc649bd96939619a87a3395; no voters:
I20260812 00:26:48.405704 11954 leader_election.cc:288] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:48.405881 11967 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:48.406955 11967 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [term 1 LEADER]: Becoming Leader. State: Replica: 9d53c4a0ffc649bd96939619a87a3395, State: Running, Role: LEADER
I20260812 00:26:48.407545 11967 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d53c4a0ffc649bd96939619a87a3395" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35531 } }
I20260812 00:26:48.408078 11954 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:48.410372 11969 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d53c4a0ffc649bd96939619a87a3395. Latest consensus state: current_term: 1 leader_uuid: "9d53c4a0ffc649bd96939619a87a3395" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d53c4a0ffc649bd96939619a87a3395" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35531 } } }
I20260812 00:26:48.410869 11969 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:48.411408 11968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d53c4a0ffc649bd96939619a87a3395" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d53c4a0ffc649bd96939619a87a3395" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 35531 } } }
I20260812 00:26:48.411810 11968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:48.417711 11972 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:48.422374 11972 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:48.431326 11972 catalog_manager.cc:1347] Generated new cluster ID: 4ca5881ff8054fce9334608b7fb2a6b7
I20260812 00:26:48.431481 11972 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:48.443756 11972 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:48.445315 11972 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:48.454916 11972 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d53c4a0ffc649bd96939619a87a3395: Generated new TSK 0
I20260812 00:26:48.455992 11972 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:48.473932 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 11882
W20260812 00:26:48.475618 11949 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54879
W20260812 00:26:48.476401 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 11882: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:26:48.476579 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 11882
2026-08-12T00:26:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2243 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:48 dist-test-slave-njxd krb5kdc[11989](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:48 dist-test-slave-njxd krb5kdc[11989](info): set up 2 sockets
Aug 12 00:26:48 dist-test-slave-njxd krb5kdc[11989](info): commencing operation
krb5kdc: starting...
W20260812 00:26:49.703418 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.000s sys 0.065s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:49 dist-test-slave-njxd krb5kdc[11989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494409, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:26:50.102047 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:36525
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:33387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:36525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:50.475428 12003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:50.475761 12003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:50.475929 12003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:50.483772 12003 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:50.483915 12003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:50.484009 12003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:50.484123 12003 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:50.484218 12003 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:50.494827 12003 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:33387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:36525
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:36525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:50.496335 12003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:50.497830 12003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:50.511022 12012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:50.511174 12010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:50.511641 12009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:50.512270 12003 server_base.cc:1034] running on GCE node
I20260812 00:26:50.513177 12003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:50.514945 12003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:50.516212 12003 hybrid_clock.cc:648] HybridClock initialized: now 1786494410516163 us; error 49 us; skew 500 ppm
I20260812 00:26:50.516628 12003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:50 dist-test-slave-njxd krb5kdc[11989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494410, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:50.520247 12003 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:26:50.522142 12003 webserver.cc:460] Webserver started at http://127.18.163.254:44265/ using document root <none> and password file <none>
I20260812 00:26:50.522955 12003 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:50.523125 12003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:50.523499 12003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:50.526976 12003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "5f3dcdfb39b04672a312b8c3871ac95d"
format_stamp: "Formatted at 2026-08-12 00:26:50 on dist-test-slave-njxd"
server_key: "a0dd3b689e8d8174d3b62c629d054690"
server_key_iv: "d1cf1a1d8d6c22ecf5bb9cb113f6c7c3"
server_key_version: "encryptionkey@0"
I20260812 00:26:50.527899 12003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "5f3dcdfb39b04672a312b8c3871ac95d"
format_stamp: "Formatted at 2026-08-12 00:26:50 on dist-test-slave-njxd"
server_key: "a0dd3b689e8d8174d3b62c629d054690"
server_key_iv: "d1cf1a1d8d6c22ecf5bb9cb113f6c7c3"
server_key_version: "encryptionkey@0"
I20260812 00:26:50.533936 12003 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 00:26:50.537860 12020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:50.539347 12003 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:26:50.539565 12003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "5f3dcdfb39b04672a312b8c3871ac95d"
format_stamp: "Formatted at 2026-08-12 00:26:50 on dist-test-slave-njxd"
server_key: "a0dd3b689e8d8174d3b62c629d054690"
server_key_iv: "d1cf1a1d8d6c22ecf5bb9cb113f6c7c3"
server_key_version: "encryptionkey@0"
I20260812 00:26:50.539811 12003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:50.546121 12003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:50.550413 12003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:50.550747 12003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:50.571264 12003 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:36525
I20260812 00:26:50.571254 12078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:36525 every 8 connection(s)
I20260812 00:26:50.572979 12003 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:50.577420 12079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:50.581794 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 12003
I20260812 00:26:50.582012 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:50.582517 19087 external_mini_cluster.cc:1428] Setting key 8af71142b4a7ab5ef99c0648b72f6cba
I20260812 00:26:50.589900 12079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d: Bootstrap starting.
I20260812 00:26:50.591925 12082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:50.584564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52447 (local address 127.18.163.254:36525)
0812 00:26:50.585563 (+ 999us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:50.585627 (+ 64us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:50.585686 (+ 59us) server_negotiation.cc:407] Connection header received
0812 00:26:50.588089 (+ 2403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:50.588118 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:50.588517 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:50.588894 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:50.590193 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:50.590201 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:50.590217 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:50.590240 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:50.590312 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:50.590335 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:50.590558 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:50.590670 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 00:26:50.590902 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":759,"thread_start_us":408,"threads_started":1}
I20260812 00:26:50.593627 12079 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:50.595006 12079 log.cc:824] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:50.596313 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:50.598874 12079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d: No bootstrap required, opened a new log
I20260812 00:26:50.604892 12082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:50.601882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49045 (local address 127.18.163.254:36525)
0812 00:26:50.602126 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:50.602137 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:50.602685 (+ 548us) server_negotiation.cc:407] Connection header received
0812 00:26:50.602889 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:50.602893 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:50.602953 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:50.603041 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:50.604136 (+ 1095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:50.604140 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:50.604143 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:26:50.604162 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:50.604206 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:26:50.604223 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:50.604320 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:50.604459 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 00:26:50.604512 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:26:50.608896 12079 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3dcdfb39b04672a312b8c3871ac95d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36525 } }
I20260812 00:26:50.609367 12079 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:26:50.609498 12079 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f3dcdfb39b04672a312b8c3871ac95d, State: Initialized, Role: FOLLOWER
I20260812 00:26:50.610212 12079 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3dcdfb39b04672a312b8c3871ac95d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36525 } }
I20260812 00:26:50.610452 12079 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:26:50.610558 12079 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:26:50.610695 12079 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:50.613026 12079 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3dcdfb39b04672a312b8c3871ac95d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36525 } }
I20260812 00:26:50.613639 12079 leader_election.cc:302] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f3dcdfb39b04672a312b8c3871ac95d; no voters:
I20260812 00:26:50.614271 12079 leader_election.cc:288] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:26:50.614427 12089 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:50.615135 12089 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [term 1 LEADER]: Becoming Leader. State: Replica: 5f3dcdfb39b04672a312b8c3871ac95d, State: Running, Role: LEADER
I20260812 00:26:50.615689 12089 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3dcdfb39b04672a312b8c3871ac95d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36525 } }
I20260812 00:26:50.616472 12079 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:50.618991 12092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f3dcdfb39b04672a312b8c3871ac95d. Latest consensus state: current_term: 1 leader_uuid: "5f3dcdfb39b04672a312b8c3871ac95d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3dcdfb39b04672a312b8c3871ac95d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36525 } } }
I20260812 00:26:50.619524 12092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:50.620132 12090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f3dcdfb39b04672a312b8c3871ac95d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3dcdfb39b04672a312b8c3871ac95d" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 36525 } } }
I20260812 00:26:50.620471 12090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:50.620568 12098 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:50.627292 12098 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:50.637494 12098 catalog_manager.cc:1347] Generated new cluster ID: dda5362ef0334b559218b06df0a8246f
I20260812 00:26:50.637671 12098 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:50.674890 12098 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:50.675442 12098 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:50.682920 12098 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f3dcdfb39b04672a312b8c3871ac95d: Generated new TSK 0
I20260812 00:26:50.683871 12098 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:50.694918 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 12003
W20260812 00:26:50.696417 12074 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:52447
W20260812 00:26:50.697233 19087 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 12003: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:26:50.697407 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 12003
2026-08-12T00:26:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2217 ms)
[----------] 18 tests from AuthTokenIssuingTest (40866 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:50 dist-test-slave-njxd krb5kdc[12112](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:50 dist-test-slave-njxd krb5kdc[12112](info): set up 2 sockets
Aug 12 00:26:50 dist-test-slave-njxd krb5kdc[12112](info): commencing operation
krb5kdc: starting...
W20260812 00:26:51.941836 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.008s sys 0.060s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:52 dist-test-slave-njxd krb5kdc[12112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:26:52.341778 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44487
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:33959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:44487,127.18.163.253:38329,127.18.163.252:38649
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:52.936389 12130 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:26:52.937443 12130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:52.937690 12130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:52.937920 12130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:52.971544 12130 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:52.971921 12130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:52.972244 12130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:52.972556 12130 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:52.972949 12130 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:53.011258 12130 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:33959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:44487,127.18.163.253:38329,127.18.163.252:38649
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:44487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:53.016683 12130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:53.022775 12130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:53.064191 12135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:53.064201 12136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:53.065317 12138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:53.067329 12130 server_base.cc:1034] running on GCE node
I20260812 00:26:53.070606 12130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:53.079365 12130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:53.083642 12130 hybrid_clock.cc:648] HybridClock initialized: now 1786494413083162 us; error 260 us; skew 500 ppm
I20260812 00:26:53.085809 12130 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:53 dist-test-slave-njxd krb5kdc[12112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494413, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:53.097678 12130 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:26:53.104681 12130 webserver.cc:460] Webserver started at http://127.18.163.254:33015/ using document root <none> and password file <none>
I20260812 00:26:53.107538 12130 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:53.107936 12130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:53.108999 12130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:53.122014 12130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "966d764598604f5b8458848ba0aaee68"
format_stamp: "Formatted at 2026-08-12 00:26:53 on dist-test-slave-njxd"
server_key: "9f7a9f27c91fe330c28a3e8062e8fb7d"
server_key_iv: "c342c5baa4600edbc2b8c41da4b1cf72"
server_key_version: "encryptionkey@0"
I20260812 00:26:53.124915 12130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "966d764598604f5b8458848ba0aaee68"
format_stamp: "Formatted at 2026-08-12 00:26:53 on dist-test-slave-njxd"
server_key: "9f7a9f27c91fe330c28a3e8062e8fb7d"
server_key_iv: "c342c5baa4600edbc2b8c41da4b1cf72"
server_key_version: "encryptionkey@0"
I20260812 00:26:53.149309 12130 fs_manager.cc:691] Time spent creating directory manager: real 0.023s user 0.013s sys 0.005s
I20260812 00:26:53.160403 12145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:53.164402 12130 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.006s sys 0.000s
I20260812 00:26:53.165184 12130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "966d764598604f5b8458848ba0aaee68"
format_stamp: "Formatted at 2026-08-12 00:26:53 on dist-test-slave-njxd"
server_key: "9f7a9f27c91fe330c28a3e8062e8fb7d"
server_key_iv: "c342c5baa4600edbc2b8c41da4b1cf72"
server_key_version: "encryptionkey@0"
I20260812 00:26:53.165987 12130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:53.228672 12130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:53.246294 12130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:53.247519 12130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:53.315104 12130 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:44487
I20260812 00:26:53.315126 12202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:44487 every 8 connection(s)
I20260812 00:26:53.319996 12130 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:53.325063 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 12130
I20260812 00:26:53.325670 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:53.327373 19087 external_mini_cluster.cc:1428] Setting key b550b50de335c91ae8a014aa48c2d157
I20260812 00:26:53.332501 12203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:53.355721 12203 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:26:53 dist-test-slave-njxd krb5kdc[12112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494413, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.163.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.253@KRBTEST.COM" created.
I20260812 00:26:53.440694 12205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:53.365187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37182 (local address 127.18.163.254:44487)
0812 00:26:53.367602 (+ 2415us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:53.367664 (+ 62us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:53.368923 (+ 1259us) server_negotiation.cc:407] Connection header received
0812 00:26:53.379770 (+ 10847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:53.379804 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:53.380713 (+ 909us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:53.381278 (+ 565us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:53.387692 (+ 6414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:53.391313 (+ 3621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:53.399627 (+ 8314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:53.402302 (+ 2675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:53.402655 (+ 353us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:53.415490 (+ 12835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:53.415524 (+ 34us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:53.415573 (+ 49us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:53.415659 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:53.424351 (+ 8692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:53.426821 (+ 2470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:53.426837 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:53.426842 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:53.427342 (+ 500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:53.428526 (+ 1184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:53.428534 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:53.428537 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:53.430272 (+ 1735us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:53.431101 (+ 829us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:53.433087 (+ 1986us) server_negotiation.cc:299] Negotiation successful
0812 00:26:53.433945 (+ 858us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1574,"thread_start_us":963,"threads_started":1}
I20260812 00:26:53.440717 12206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:53.365187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44487 (local address 127.0.0.1:37182)
0812 00:26:53.368357 (+ 3170us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:53.368583 (+ 226us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:53.378242 (+ 9659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:53.381854 (+ 3612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:53.381923 (+ 69us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:53.384569 (+ 2646us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:53.386997 (+ 2428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:53.387038 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:53.391699 (+ 4661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:53.391719 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:53.398848 (+ 7129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:53.399027 (+ 179us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:53.402964 (+ 3937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:53.402979 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:53.404336 (+ 1357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:53.406949 (+ 2613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:26:53.407071 (+ 122us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:53.414989 (+ 7918us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:53.424973 (+ 9984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:53.425020 (+ 47us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:53.425064 (+ 44us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:53.426360 (+ 1296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:53.427817 (+ 1457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:53.427857 (+ 40us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:53.427876 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:53.428264 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:53.430913 (+ 2649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:53.430932 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:53.431684 (+ 752us) client_negotiation.cc:769] Sending connection context
0812 00:26:53.432602 (+ 918us) client_negotiation.cc:240] Negotiation successful
0812 00:26:53.434380 (+ 1778us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2423,"mutex_wait_us":380,"thread_start_us":1851,"threads_started":1}
I20260812 00:26:53.451319 12203 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:26:53.456260 12206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:53.453702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:38329 (local address 127.0.0.1:40536)
0812 00:26:53.454667 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:53.455299 (+ 632us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239}
W20260812 00:26:53.457700 12149 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
I20260812 00:26:53.465155 12206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:53.462549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:38329 (local address 127.0.0.1:40548)
0812 00:26:53.463117 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:53.463841 (+ 724us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260812 00:26:53.465852 12203 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.253:38329: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
I20260812 00:26:53.515960 12203 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } attempt: 1
I20260812 00:26:53.519256 12206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:53.517997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:38329 (local address 127.0.0.1:40564)
0812 00:26:53.518473 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:53.518816 (+ 343us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223}
I20260812 00:26:53.522091 12206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:53.521112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:38329 (local address 127.0.0.1:40576)
0812 00:26:53.521451 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:53.521790 (+ 339us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260812 00:26:53.522586 12203 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.253:38329: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.253.keytab.
Entry for principal kudu/127.18.163.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.253.keytab.
W20260812 00:26:53.535362 19087 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.18.163.253: real 0.207s user 0.003s sys 0.088s
I20260812 00:26:53.538514 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.253:38329
--webserver_interface=127.18.163.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.253.keytab
--principal=kudu/127.18.163.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:33959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:44487,127.18.163.253:38329,127.18.163.252:38649
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:26:53.591391 12203 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } attempt: 2
I20260812 00:26:53.594936 12206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:53.593406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:38329 (local address 127.0.0.1:40588)
0812 00:26:53.594157 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:53.594382 (+ 225us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258}
I20260812 00:26:53.599351 12206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:53.597148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:38329 (local address 127.0.0.1:40600)
0812 00:26:53.598103 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:53.598717 (+ 614us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
W20260812 00:26:53.600032 12203 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.253:38329: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
I20260812 00:26:53.691689 12203 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } attempt: 3
I20260812 00:26:53.696048 12206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:53.693833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:38329 (local address 127.0.0.1:40604)
0812 00:26:53.694668 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:53.695327 (+ 659us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234}
I20260812 00:26:53.700752 12206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:53.699523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:38329 (local address 127.0.0.1:40610)
0812 00:26:53.699984 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:53.700304 (+ 320us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164}
W20260812 00:26:53.701392 12203 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.253:38329: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
I20260812 00:26:53.844905 12203 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } attempt: 4
I20260812 00:26:53.846287 12206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:53.845728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:38329 (local address 127.0.0.1:40614)
0812 00:26:53.846019 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:53.846123 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156}
I20260812 00:26:53.847605 12206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:53.847125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:38329 (local address 127.0.0.1:40630)
0812 00:26:53.847330 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:53.847441 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260812 00:26:53.847824 12203 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.253:38329: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
W20260812 00:26:54.080766 12214 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:26:54.081174 12214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:54.081318 12214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:54.081451 12214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:54.089182 12214 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:54.089298 12214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:54.089406 12214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:54.089489 12214 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:54.089617 12214 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:54.100103 12214 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:33959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:44487,127.18.163.253:38329,127.18.163.252:38649
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.253.keytab
--principal=kudu/127.18.163.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.253:38329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.163.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:54.101651 12214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:54.103168 12214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:54.116189 12221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:54.116135 12223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:54.116794 12220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:54.117347 12214 server_base.cc:1034] running on GCE node
I20260812 00:26:54.118392 12214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:54.120057 12214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:54.121343 12214 hybrid_clock.cc:648] HybridClock initialized: now 1786494414121275 us; error 49 us; skew 500 ppm
I20260812 00:26:54.121800 12214 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:54 dist-test-slave-njxd krb5kdc[12112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494414, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:54.125360 12214 init.cc:377] Logged in from keytab as kudu/127.18.163.253@KRBTEST.COM (short username kudu)
I20260812 00:26:54.127163 12214 webserver.cc:460] Webserver started at http://127.18.163.253:38219/ using document root <none> and password file <none>
I20260812 00:26:54.128002 12214 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:54.128159 12214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:54.128530 12214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:54.131951 12214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-1/data/instance:
uuid: "0f380060ea294e66b9db9588f99089c4"
format_stamp: "Formatted at 2026-08-12 00:26:54 on dist-test-slave-njxd"
server_key: "3b996ab12224e398e208a4f18ec59dec"
server_key_iv: "e228970d8c60a729ca73192084f8e706"
server_key_version: "encryptionkey@0"
I20260812 00:26:54.132874 12214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-1/wal/instance:
uuid: "0f380060ea294e66b9db9588f99089c4"
format_stamp: "Formatted at 2026-08-12 00:26:54 on dist-test-slave-njxd"
server_key: "3b996ab12224e398e208a4f18ec59dec"
server_key_iv: "e228970d8c60a729ca73192084f8e706"
server_key_version: "encryptionkey@0"
I20260812 00:26:54.138896 12214 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 00:26:54.142918 12231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:54.144484 12214 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:26:54.144721 12214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-1/wal
uuid: "0f380060ea294e66b9db9588f99089c4"
format_stamp: "Formatted at 2026-08-12 00:26:54 on dist-test-slave-njxd"
server_key: "3b996ab12224e398e208a4f18ec59dec"
server_key_iv: "e228970d8c60a729ca73192084f8e706"
server_key_version: "encryptionkey@0"
I20260812 00:26:54.144999 12214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:54.147101 12203 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } attempt: 5
I20260812 00:26:54.148342 12206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.147823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:38329 (local address 127.0.0.1:40638)
0812 00:26:54.148024 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.148150 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260812 00:26:54.149435 12206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.149040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:38329 (local address 127.0.0.1:40652)
0812 00:26:54.149206 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.149301 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 00:26:54.149657 12203 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.253:38329: Network error: Client connection negotiation failed: client connection to 127.18.163.253:38329: connect: Connection refused (error 111)
I20260812 00:26:54.182096 12214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:54.186839 12214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:54.187166 12214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:54.207831 12214 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.253:38329
I20260812 00:26:54.207839 12285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.253:38329 every 8 connection(s)
I20260812 00:26:54.209411 12214 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-1/data/info.pb
I20260812 00:26:54.209829 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 12214
I20260812 00:26:54.210012 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-1/wal/instance
I20260812 00:26:54.210496 19087 external_mini_cluster.cc:1428] Setting key 11b3409b080ec9b2c8228edba4efb7c6
I20260812 00:26:54.215150 12286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:54.226317 12286 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:26:54 dist-test-slave-njxd krb5kdc[12112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494414, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.253@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.163.252@KRBTEST.COM; defaulting to no policy
I20260812 00:26:54.254720 12289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.230237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37186 (local address 127.18.163.254:44487)
0812 00:26:54.230819 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:54.230826 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:54.232062 (+ 1236us) server_negotiation.cc:407] Connection header received
0812 00:26:54.235349 (+ 3287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:54.235355 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:54.235453 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:54.235618 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:54.237468 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.238298 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.240262 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.240761 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.240955 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.246516 (+ 5561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:54.246522 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:54.246526 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:54.246592 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:54.250605 (+ 4013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.251668 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.251675 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.251678 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.251834 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.252348 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.252354 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.252359 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.252735 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:54.252912 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:54.253885 (+ 973us) server_negotiation.cc:299] Negotiation successful
0812 00:26:54.254170 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":293,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.252@KRBTEST.COM" created.
I20260812 00:26:54.255962 12292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.230912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44487 (local address 127.0.0.1:37186)
0812 00:26:54.231831 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.231896 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:54.234964 (+ 3068us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:54.235938 (+ 974us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:54.235948 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:54.236548 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:54.237212 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:54.237231 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.238511 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.238516 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:54.239973 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:54.239995 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.241122 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.241133 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:54.241469 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.242508 (+ 1039us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:26:54.242543 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:54.246055 (+ 3512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:54.250839 (+ 4784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:54.250849 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:54.250884 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:54.251492 (+ 608us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:54.251987 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:54.251991 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:54.251993 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:54.252210 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:54.252891 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:54.252901 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:54.253380 (+ 479us) client_negotiation.cc:769] Sending connection context
0812 00:26:54.253798 (+ 418us) client_negotiation.cc:240] Negotiation successful
0812 00:26:54.254423 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":347,"threads_started":1}
I20260812 00:26:54.258196 12286 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:26:54 dist-test-slave-njxd krb5kdc[12112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494414, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.253@KRBTEST.COM for kudu/127.18.163.253@KRBTEST.COM
I20260812 00:26:54.277694 12292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.259003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:38329 (local address 127.0.0.1:40658)
0812 00:26:54.259361 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.259385 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:54.259518 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:54.260546 (+ 1028us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:54.260557 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:54.261169 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:54.261410 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:54.261426 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.262988 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.262997 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:54.264511 (+ 1514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:54.264532 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.265450 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.265459 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:54.265723 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.266445 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:26:54.266474 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:54.269381 (+ 2907us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:54.274374 (+ 4993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:54.274382 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:54.274388 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:54.275055 (+ 667us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:54.275529 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:54.275537 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:54.275544 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:54.275733 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:54.276406 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:54.276414 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:54.276598 (+ 184us) client_negotiation.cc:769] Sending connection context
0812 00:26:54.276765 (+ 167us) client_negotiation.cc:240] Negotiation successful
0812 00:26:54.277153 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199}
I20260812 00:26:54.277724 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.259294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40658 (local address 127.18.163.253:38329)
0812 00:26:54.260060 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:54.260066 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:54.260102 (+ 36us) server_negotiation.cc:407] Connection header received
0812 00:26:54.260155 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:54.260161 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:54.260360 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:54.260490 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:54.261699 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.262821 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.264679 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.265275 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.265378 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.269701 (+ 4323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:54.269726 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:54.269751 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:54.269814 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:54.274162 (+ 4348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.275239 (+ 1077us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.275246 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.275248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.275383 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.275849 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.275852 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.275854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.276263 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:54.276438 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:54.276909 (+ 471us) server_negotiation.cc:299] Negotiation successful
0812 00:26:54.277334 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":166,"server-negotiator.queue_time_us":593,"thread_start_us":440,"threads_started":1}
I20260812 00:26:54.280531 12286 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:26:54.281809 12292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.281222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:38649 (local address 127.0.0.1:48602)
0812 00:26:54.281400 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.281548 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260812 00:26:54.282063 12235 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
I20260812 00:26:54.283803 12292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.283396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:38649 (local address 127.0.0.1:48612)
0812 00:26:54.283592 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.283686 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 00:26:54.284039 12286 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:38649: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.252.keytab.
Entry for principal kudu/127.18.163.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.252.keytab.
I20260812 00:26:54.301798 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.252:38649
--webserver_interface=127.18.163.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.252.keytab
--principal=kudu/127.18.163.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:33959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:44487,127.18.163.253:38329,127.18.163.252:38649
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:26:54.333367 12286 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } attempt: 1
I20260812 00:26:54.334656 12292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.334139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:38649 (local address 127.0.0.1:48620)
0812 00:26:54.334340 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.334461 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 00:26:54.335722 12292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.335347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:38649 (local address 127.0.0.1:48628)
0812 00:26:54.335531 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.335613 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 00:26:54.335988 12286 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:38649: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
I20260812 00:26:54.404304 12286 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } attempt: 2
I20260812 00:26:54.405673 12292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.405101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:38649 (local address 127.0.0.1:48638)
0812 00:26:54.405321 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.405427 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260812 00:26:54.406792 12292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.406392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:38649 (local address 127.0.0.1:48650)
0812 00:26:54.406553 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.406664 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 00:26:54.407068 12286 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:38649: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
I20260812 00:26:54.498358 12286 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } attempt: 3
I20260812 00:26:54.499734 12292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.499180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:38649 (local address 127.0.0.1:48660)
0812 00:26:54.499418 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.499520 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260812 00:26:54.501106 12292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.500626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:38649 (local address 127.0.0.1:48674)
0812 00:26:54.500880 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.500971 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160}
W20260812 00:26:54.501442 12286 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:38649: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
I20260812 00:26:54.644696 12286 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } attempt: 4
I20260812 00:26:54.646044 12292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.645483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:38649 (local address 127.0.0.1:48678)
0812 00:26:54.645756 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.645851 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260812 00:26:54.647112 12292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.646741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:38649 (local address 127.0.0.1:48682)
0812 00:26:54.646904 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.646989 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 00:26:54.647349 12286 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:38649: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
W20260812 00:26:54.680997 12296 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:26:54.681455 12296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:54.681628 12296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:54.681780 12296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:54.689726 12296 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:54.689883 12296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:54.689996 12296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:54.690106 12296 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:54.690200 12296 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:54.696907 12203 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } attempt: 6
I20260812 00:26:54.701686 12296 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:33959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:44487,127.18.163.253:38329,127.18.163.252:38649
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.252.keytab
--principal=kudu/127.18.163.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.252:38649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.163.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:54.703349 12296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:54.704880 12296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 12 00:26:54 dist-test-slave-njxd krb5kdc[12112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494413, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for kudu/127.18.163.253@KRBTEST.COM
I20260812 00:26:54.712976 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.697906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40672 (local address 127.18.163.253:38329)
0812 00:26:54.698154 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:54.698161 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:54.698416 (+ 255us) server_negotiation.cc:407] Connection header received
0812 00:26:54.698681 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:54.698685 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:54.698761 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:54.698874 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:54.699702 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.700427 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.701716 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.702258 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.702404 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.706131 (+ 3727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:54.706139 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:54.706144 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:54.706189 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:54.709769 (+ 3580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.710646 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.710651 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.710654 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.710795 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.711232 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.711236 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.711238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.711609 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:54.711814 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:54.712320 (+ 506us) server_negotiation.cc:299] Negotiation successful
0812 00:26:54.712612 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260812 00:26:54.713224 12300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.697766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:38329 (local address 127.0.0.1:40672)
0812 00:26:54.698298 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.698315 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:54.698502 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:54.698920 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:54.698928 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:54.699360 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:54.699539 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:54.699549 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.700578 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.700586 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:54.701499 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:54.701512 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.702432 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.702438 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:54.702659 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.703412 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:26:54.703434 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:54.705871 (+ 2437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:54.709980 (+ 4109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:54.709985 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:54.709988 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:54.710463 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:54.710930 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:54.710942 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:54.710944 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:54.711093 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:54.711788 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:54.711794 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:54.711982 (+ 188us) client_negotiation.cc:769] Sending connection context
0812 00:26:54.712164 (+ 182us) client_negotiation.cc:240] Negotiation successful
0812 00:26:54.712612 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":285,"threads_started":1}
I20260812 00:26:54.714648 12203 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:26:54.715940 12300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.715403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:38649 (local address 127.0.0.1:48688)
0812 00:26:54.715670 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.715776 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260812 00:26:54.717620 12300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.717147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:38649 (local address 127.0.0.1:48702)
0812 00:26:54.717335 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.717430 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260812 00:26:54.717890 12203 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:38649: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
W20260812 00:26:54.721371 12303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:54.721344 12306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:54.721410 12304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:54.722406 12296 server_base.cc:1034] running on GCE node
I20260812 00:26:54.723351 12296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:54.725006 12296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:54.726296 12296 hybrid_clock.cc:648] HybridClock initialized: now 1786494414726208 us; error 64 us; skew 500 ppm
I20260812 00:26:54.726711 12296 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:54 dist-test-slave-njxd krb5kdc[12112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494414, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:54.730449 12296 init.cc:377] Logged in from keytab as kudu/127.18.163.252@KRBTEST.COM (short username kudu)
I20260812 00:26:54.732167 12296 webserver.cc:460] Webserver started at http://127.18.163.252:35803/ using document root <none> and password file <none>
I20260812 00:26:54.732955 12296 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:54.733067 12296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:54.733377 12296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:54.736963 12296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-2/data/instance:
uuid: "3ee56bf94b35437c9513743c4426ce6b"
format_stamp: "Formatted at 2026-08-12 00:26:54 on dist-test-slave-njxd"
server_key: "b7fba44b6ddb97144d4ec073a2730658"
server_key_iv: "621c0404bc30f67b49863ff31a4a304d"
server_key_version: "encryptionkey@0"
I20260812 00:26:54.737955 12296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-2/wal/instance:
uuid: "3ee56bf94b35437c9513743c4426ce6b"
format_stamp: "Formatted at 2026-08-12 00:26:54 on dist-test-slave-njxd"
server_key: "b7fba44b6ddb97144d4ec073a2730658"
server_key_iv: "621c0404bc30f67b49863ff31a4a304d"
server_key_version: "encryptionkey@0"
I20260812 00:26:54.743808 12296 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:26:54.747705 12317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:54.749293 12296 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:26:54.749529 12296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-2/wal
uuid: "3ee56bf94b35437c9513743c4426ce6b"
format_stamp: "Formatted at 2026-08-12 00:26:54 on dist-test-slave-njxd"
server_key: "b7fba44b6ddb97144d4ec073a2730658"
server_key_iv: "621c0404bc30f67b49863ff31a4a304d"
server_key_version: "encryptionkey@0"
I20260812 00:26:54.749862 12296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:54.770130 12203 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } attempt: 1
I20260812 00:26:54.771339 12300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.770861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:38649 (local address 127.0.0.1:48704)
0812 00:26:54.771082 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.771197 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260812 00:26:54.772502 12300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.772071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:38649 (local address 127.0.0.1:48706)
0812 00:26:54.772245 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.772333 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 00:26:54.772727 12203 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:38649: Network error: Client connection negotiation failed: client connection to 127.18.163.252:38649: connect: Connection refused (error 111)
I20260812 00:26:54.780516 12296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:54.784864 12296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:54.785167 12296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:54.806237 12296 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.252:38649
I20260812 00:26:54.806255 12379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.252:38649 every 8 connection(s)
I20260812 00:26:54.807844 12296 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-2/data/info.pb
I20260812 00:26:54.812230 12380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:54.812516 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 12296
I20260812 00:26:54.812731 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494024564100-19087-0/minicluster-data/master-2/wal/instance
I20260812 00:26:54.813298 19087 external_mini_cluster.cc:1428] Setting key 9dd18e6147f1bd3e6764ea5988592c72
I20260812 00:26:54.822096 12380 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:26:54 dist-test-slave-njxd krb5kdc[12112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.252@KRBTEST.COM
Aug 12 00:26:54 dist-test-slave-njxd krb5kdc[12112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494414, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.252@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:26:54.840561 12383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.815573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48712 (local address 127.18.163.252:38649)
0812 00:26:54.816582 (+ 1009us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:54.816594 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:54.816640 (+ 46us) server_negotiation.cc:407] Connection header received
0812 00:26:54.819254 (+ 2614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:54.819285 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:54.819808 (+ 523us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:54.820327 (+ 519us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:54.822122 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.823578 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.825045 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.826314 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.826509 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.831567 (+ 5058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:54.831578 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:54.831597 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:54.831659 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:54.835562 (+ 3903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.836358 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.836367 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.836378 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.836588 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.837028 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.837034 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.837039 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.837916 (+ 877us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:54.838263 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:54.838638 (+ 375us) server_negotiation.cc:299] Negotiation successful
0812 00:26:54.839129 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":754,"thread_start_us":480,"threads_started":1}
I20260812 00:26:54.842329 12385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.824903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37194 (local address 127.18.163.254:44487)
0812 00:26:54.826475 (+ 1572us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:54.826482 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:54.826500 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:26:54.826563 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:54.826568 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:54.826666 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:54.826783 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:54.828533 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.829370 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.831183 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.831814 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.831957 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.835888 (+ 3931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:54.835893 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:54.835896 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:54.835943 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:54.839385 (+ 3442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.840147 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.840152 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.840156 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.840312 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.840708 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.840713 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.840716 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.841109 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:54.841292 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:54.841759 (+ 467us) server_negotiation.cc:299] Negotiation successful
0812 00:26:54.842005 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1437,"thread_start_us":1285,"threads_started":1}
I20260812 00:26:54.842399 12384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.824813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:44487 (local address 127.0.0.1:37194)
0812 00:26:54.825751 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.825813 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:54.825978 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:54.826908 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:54.826917 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:54.827940 (+ 1023us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:54.828326 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:54.828349 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.829550 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.829557 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:54.830974 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:54.830992 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.832022 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.832030 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:54.832204 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.832967 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:26:54.832984 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:54.835657 (+ 2673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:54.839523 (+ 3866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:54.839534 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:54.839539 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:54.839996 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:54.840429 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:54.840432 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:54.840434 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:54.840570 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:54.841249 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:54.841255 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:54.841431 (+ 176us) client_negotiation.cc:769] Sending connection context
0812 00:26:54.841636 (+ 205us) client_negotiation.cc:240] Negotiation successful
0812 00:26:54.841957 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":399,"threads_started":1}
I20260812 00:26:54.844035 12380 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:26:54.846956 12203 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } attempt: 2
Aug 12 00:26:54 dist-test-slave-njxd krb5kdc[12112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494414, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.252@KRBTEST.COM for kudu/127.18.163.253@KRBTEST.COM
Aug 12 00:26:54 dist-test-slave-njxd krb5kdc[12112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
Aug 12 00:26:54 dist-test-slave-njxd krb5kdc[12112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494413, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for kudu/127.18.163.252@KRBTEST.COM
I20260812 00:26:54.862185 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.844898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40678 (local address 127.18.163.253:38329)
0812 00:26:54.845160 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:54.845166 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:54.845184 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:26:54.845243 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:54.845247 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:54.845303 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:54.845412 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:54.846213 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.846961 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.848869 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.849501 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.849692 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.854507 (+ 4815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:54.854515 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:54.854521 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:54.854579 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:54.858397 (+ 3818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.859461 (+ 1064us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.859468 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.859471 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.859651 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.860245 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.860252 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.860259 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.860700 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:54.860874 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:54.861377 (+ 503us) server_negotiation.cc:299] Negotiation successful
0812 00:26:54.861707 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:26:54.862460 12385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.844338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37206 (local address 127.18.163.254:44487)
0812 00:26:54.844522 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:54.844528 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:54.844548 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:26:54.844631 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:54.844636 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:54.844744 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:54.844843 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:54.846330 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.847110 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.848904 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.849557 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.849706 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.855192 (+ 5486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:54.855200 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:54.855207 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:54.855253 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:54.859006 (+ 3753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.860087 (+ 1081us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.860093 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.860097 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.860261 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.860703 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.860708 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.860711 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.861155 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:54.861460 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:54.861861 (+ 401us) server_negotiation.cc:299] Negotiation successful
0812 00:26:54.862108 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 00:26:54.863245 12384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.844747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:38329 (local address 127.0.0.1:40678)
0812 00:26:54.844918 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.844957 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:54.845062 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:54.845439 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:54.845443 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:54.845900 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:54.846050 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:54.846059 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.847126 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.847131 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:54.848696 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:54.848711 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.849918 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.849925 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:54.850137 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.851160 (+ 1023us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:26:54.851186 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:54.854228 (+ 3042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:54.858579 (+ 4351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:54.858585 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:54.858590 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:54.859292 (+ 702us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:54.859851 (+ 559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:54.859856 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:54.859859 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:54.860090 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:54.860848 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:54.860853 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:54.861036 (+ 183us) client_negotiation.cc:769] Sending connection context
0812 00:26:54.862491 (+ 1455us) client_negotiation.cc:240] Negotiation successful
0812 00:26:54.862873 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260812 00:26:54.864306 12380 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:26:54.864410 12300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.847560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:38649 (local address 127.0.0.1:48718)
0812 00:26:54.847816 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.847835 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:54.847950 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:54.848286 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:54.848291 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:54.848710 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:54.848912 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:54.848923 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.850427 (+ 1504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.850435 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:54.851964 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:54.851981 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.853131 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.853138 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:54.853385 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.854161 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:26:54.854187 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:54.857179 (+ 2992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:54.860985 (+ 3806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:54.860991 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:54.860995 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:54.861550 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:54.862006 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:54.862010 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:54.862013 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:54.862225 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:54.863251 (+ 1026us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:54.863256 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:54.863430 (+ 174us) client_negotiation.cc:769] Sending connection context
0812 00:26:54.863764 (+ 334us) client_negotiation.cc:240] Negotiation successful
0812 00:26:54.864007 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140}
I20260812 00:26:54.865520 12383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.847708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48718 (local address 127.18.163.252:38649)
0812 00:26:54.847873 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:54.847878 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:54.847896 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:26:54.848078 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:54.848083 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:54.848157 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:54.848259 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:54.849065 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.850250 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.852156 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.852936 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.853081 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.857419 (+ 4338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:54.857426 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:54.857431 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:54.857478 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:54.860817 (+ 3339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.861698 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.861703 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.861706 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.861857 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.862690 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.862695 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.862698 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.863106 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:54.863273 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:54.864838 (+ 1565us) server_negotiation.cc:299] Negotiation successful
0812 00:26:54.865133 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 00:26:54.872399 12203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68: Bootstrap starting.
Aug 12 00:26:54 dist-test-slave-njxd krb5kdc[12112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.253@KRBTEST.COM
I20260812 00:26:54.876557 12203 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68: Neither blocks nor log segments found. Creating new log.
Aug 12 00:26:54 dist-test-slave-njxd krb5kdc[12112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494414, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.252@KRBTEST.COM for kudu/127.18.163.252@KRBTEST.COM
I20260812 00:26:54.878243 12203 log.cc:824] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:54.881964 12203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68: No bootstrap required, opened a new log
I20260812 00:26:54.885217 12384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.866224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:38649 (local address 127.0.0.1:48728)
0812 00:26:54.866474 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.866494 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:54.866623 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:54.867054 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:54.867061 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:54.867577 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:54.867791 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:54.867804 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.870685 (+ 2881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.870694 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:54.871997 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:54.872014 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.873090 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.873098 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:54.873338 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.874192 (+ 854us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:26:54.874221 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:54.877804 (+ 3583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:54.882161 (+ 4357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:54.882166 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:54.882171 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:54.882582 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:54.883063 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:54.883068 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:54.883072 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:54.883249 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:54.884021 (+ 772us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:54.884028 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:54.884222 (+ 194us) client_negotiation.cc:769] Sending connection context
0812 00:26:54.884393 (+ 171us) client_negotiation.cc:240] Negotiation successful
0812 00:26:54.884782 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147}
I20260812 00:26:54.885839 12383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.865217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48728 (local address 127.18.163.252:38649)
0812 00:26:54.866253 (+ 1036us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:54.866261 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:54.866577 (+ 316us) server_negotiation.cc:407] Connection header received
0812 00:26:54.866799 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:54.866807 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:54.866889 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:54.866991 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:54.869365 (+ 2374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.870489 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.872190 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.872873 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.873011 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.878031 (+ 5020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:54.878039 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:54.878044 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:54.878084 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:54.881995 (+ 3911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.882748 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.882754 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.882761 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.882920 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.883391 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.883398 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.883405 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.883878 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:54.884027 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:54.884568 (+ 541us) server_negotiation.cc:299] Negotiation successful
0812 00:26:54.884993 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":144,"server-negotiator.queue_time_us":910,"thread_start_us":768,"threads_started":1}
I20260812 00:26:54.886058 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.864748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40688 (local address 127.18.163.253:38329)
0812 00:26:54.865055 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:54.865061 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:54.865079 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:26:54.865131 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:54.865135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:54.865211 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:54.865317 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:54.867981 (+ 2664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.869180 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.870786 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.871437 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.871583 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.877640 (+ 6057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:54.877650 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:54.877655 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:54.877711 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:54.881742 (+ 4031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.882808 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.882815 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.882819 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.883005 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.883488 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.883493 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.883496 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.883856 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:54.884150 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:54.885361 (+ 1211us) server_negotiation.cc:299] Negotiation successful
0812 00:26:54.885670 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180}
I20260812 00:26:54.891913 12380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b: Bootstrap starting.
I20260812 00:26:54.892185 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:26:54.892621 12203 raft_consensus.cc:348] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } }
I20260812 00:26:54.892998 12203 raft_consensus.cc:729] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 966d764598604f5b8458848ba0aaee68, State: Initialized, Role: FOLLOWER
I20260812 00:26:54.893483 12203 consensus_queue.cc:260] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } }
I20260812 00:26:54.894672 12388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } } }
I20260812 00:26:54.895217 12388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:26:54.896100 12203 sys_catalog.cc:564] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:54.896272 12174 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "966d764598604f5b8458848ba0aaee68"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37206
I20260812 00:26:54.896600 12380 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:54.896756 12174 raft_consensus.cc:482] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 00:26:54.896993 12174 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:54.898206 12380 log.cc:824] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:54.900749 12174 raft_consensus.cc:504] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } }
I20260812 00:26:54.902601 12380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b: No bootstrap required, opened a new log
I20260812 00:26:54.902601 12174 leader_election.cc:288] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [CANDIDATE]: Term 1 election: Requested vote from peers 0f380060ea294e66b9db9588f99089c4 (127.18.163.253:38329), 3ee56bf94b35437c9513743c4426ce6b (127.18.163.252:38649)
I20260812 00:26:54.918640 12380 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } }
I20260812 00:26:54.919289 12380 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ee56bf94b35437c9513743c4426ce6b, State: Initialized, Role: FOLLOWER
I20260812 00:26:54.919924 12380 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } }
I20260812 00:26:54.923238 12380 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:54.927284 12351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "966d764598604f5b8458848ba0aaee68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3ee56bf94b35437c9513743c4426ce6b"
I20260812 00:26:54.928028 12351 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:54.933893 12351 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 966d764598604f5b8458848ba0aaee68 in term 1.
I20260812 00:26:54.927263 12403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } } }
I20260812 00:26:54.935022 12149 leader_election.cc:302] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ee56bf94b35437c9513743c4426ce6b, 966d764598604f5b8458848ba0aaee68; no voters:
I20260812 00:26:54.935045 12403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:26:54.935619 12388 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:26:54.936474 12388 raft_consensus.cc:686] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [term 1 LEADER]: Becoming Leader. State: Replica: 966d764598604f5b8458848ba0aaee68, State: Running, Role: LEADER
I20260812 00:26:54.937238 12388 consensus_queue.cc:237] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } }
I20260812 00:26:54.946522 12286 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } attempt: 5
I20260812 00:26:54.960053 12385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.921013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37218 (local address 127.18.163.254:44487)
0812 00:26:54.921301 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:54.921312 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:54.927901 (+ 6589us) server_negotiation.cc:407] Connection header received
0812 00:26:54.929481 (+ 1580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:54.929489 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:54.929611 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:54.929710 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:54.934359 (+ 4649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.935595 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.939852 (+ 4257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.940927 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.941155 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.944706 (+ 3551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:54.944721 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:54.944729 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:54.944788 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:54.954890 (+ 10102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.956049 (+ 1159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.956055 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.956058 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.956330 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.956891 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.956896 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.956899 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.957372 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:54.959173 (+ 1801us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:54.959350 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 00:26:54.959627 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
Aug 12 00:26:54 dist-test-slave-njxd krb5kdc[12112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494414, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.253@KRBTEST.COM for kudu/127.18.163.252@KRBTEST.COM
W20260812 00:26:54.989033 12408 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260812 00:26:54.989785 12383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.948421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48738 (local address 127.18.163.252:38649)
0812 00:26:54.948663 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:54.948682 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:54.948706 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:26:54.948789 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:54.948798 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:54.948940 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:54.949073 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:54.951136 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.952651 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.955468 (+ 2817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.956503 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.956678 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.963196 (+ 6518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:54.963207 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:54.963215 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:54.963277 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:54.973235 (+ 9958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.974780 (+ 1545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.974789 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.974796 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.975036 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.975669 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.975678 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.975683 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.976217 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:54.976419 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:54.978745 (+ 2326us) server_negotiation.cc:299] Negotiation successful
0812 00:26:54.979124 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 00:26:54.993568 12292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.947380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:38649 (local address 127.0.0.1:48738)
0812 00:26:54.947931 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:54.947958 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:54.948108 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:54.949528 (+ 1420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:54.949537 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:54.950369 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:54.950716 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:54.950734 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.952974 (+ 2240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.952984 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:54.955084 (+ 2100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:54.955109 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.957083 (+ 1974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.957118 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:54.957762 (+ 644us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.958799 (+ 1037us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:26:54.958825 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:54.962801 (+ 3976us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:54.973545 (+ 10744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:54.973554 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:54.973562 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:54.974506 (+ 944us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:54.975239 (+ 733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:54.975247 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:54.975254 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:54.975498 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:54.976510 (+ 1012us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:54.976519 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:54.977180 (+ 661us) client_negotiation.cc:769] Sending connection context
0812 00:26:54.977382 (+ 202us) client_negotiation.cc:240] Negotiation successful
0812 00:26:54.977911 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365}
I20260812 00:26:54.998332 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:54.928486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40704 (local address 127.18.163.253:38329)
0812 00:26:54.928710 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:54.928715 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:54.958776 (+ 30061us) server_negotiation.cc:407] Connection header received
0812 00:26:54.958958 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:54.958966 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:54.959078 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:54.959189 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:54.964857 (+ 5668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.966465 (+ 1608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.973280 (+ 6815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:54.974435 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:54.974629 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:54.984093 (+ 9464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:54.984106 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:54.984114 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:54.984188 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:54.989560 (+ 5372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.991979 (+ 2419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.991990 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.991996 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.992399 (+ 403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:54.993511 (+ 1112us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:54.993520 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:54.993527 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:54.994504 (+ 977us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:54.995116 (+ 612us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:54.996694 (+ 1578us) server_negotiation.cc:299] Negotiation successful
0812 00:26:54.997373 (+ 679us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260812 00:26:55.001438 12408 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:26:54.998837 12413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 966d764598604f5b8458848ba0aaee68. Latest consensus state: current_term: 1 leader_uuid: "966d764598604f5b8458848ba0aaee68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } } }
I20260812 00:26:55.001691 12413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [sys.catalog]: This master's current role is: LEADER
W20260812 00:26:55.006011 12152 tablet.cc:2369] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:26:54.929560 12130 master_runner.cc:186] Error getting master registration for 127.18.163.253:38329: OK, instance_id { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" instance_seqno: 1786494414201896 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:26:55.008436 12286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4: Bootstrap starting.
I20260812 00:26:55.008877 12130 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:26:55.018354 12286 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4: Neither blocks nor log segments found. Creating new log.
I20260812 00:26:55.018666 12417 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:26:55.021359 12286 log.cc:824] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:26:55.025422 12417 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:26:55.025730 12286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4: No bootstrap required, opened a new log
I20260812 00:26:55.027509 12383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:55.001763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48750 (local address 127.18.163.252:38649)
0812 00:26:55.001998 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.002006 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.004201 (+ 2195us) server_negotiation.cc:407] Connection header received
0812 00:26:55.006552 (+ 2351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.006558 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.006665 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.006750 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:55.009550 (+ 2800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.011064 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.013078 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.013860 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.013969 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:55.017922 (+ 3953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:55.017929 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:55.017935 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:55.017987 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:55.022084 (+ 4097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:55.023872 (+ 1788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:55.023878 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:55.023881 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:55.024060 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:55.024901 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:55.024906 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:55.024909 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:55.025367 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:55.025721 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:55.026819 (+ 1098us) server_negotiation.cc:299] Negotiation successful
0812 00:26:55.027101 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260812 00:26:55.037530 12324 tablet.cc:2369] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:26:55.038537 12286 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } }
I20260812 00:26:55.039033 12286 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f380060ea294e66b9db9588f99089c4, State: Initialized, Role: FOLLOWER
I20260812 00:26:55.039624 12286 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } }
I20260812 00:26:55.041914 12351 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b [term 1 FOLLOWER]: Refusing update from remote peer 966d764598604f5b8458848ba0aaee68: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:26:55.044186 12413 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:26:55.047816 12424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } } }
I20260812 00:26:55.050740 12286 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:26:55.051146 12259 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:26:55.052332 12424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:26:55.054260 12260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "966d764598604f5b8458848ba0aaee68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0f380060ea294e66b9db9588f99089c4"
I20260812 00:26:55.062063 12259 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4 [term 1 FOLLOWER]: Refusing update from remote peer 966d764598604f5b8458848ba0aaee68: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:26:55.062883 12403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 966d764598604f5b8458848ba0aaee68. Latest consensus state: current_term: 1 leader_uuid: "966d764598604f5b8458848ba0aaee68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } } }
I20260812 00:26:55.063234 12403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:26:55.066767 12260 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 966d764598604f5b8458848ba0aaee68 in term 1.
I20260812 00:26:55.067905 12403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "966d764598604f5b8458848ba0aaee68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } } }
I20260812 00:26:55.068193 12403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:26:55.068571 12422 mvcc.cc:205] Tried to move back new op lower bound from 7317481123999719424 to 7317481123589427200. Current Snapshot: MvccSnapshot[applied={T|T < 7317481123999719424}]
I20260812 00:26:55.073019 12413 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:26:55.084976 12413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "966d764598604f5b8458848ba0aaee68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } } }
I20260812 00:26:55.085297 12413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:55.087599 12426 mvcc.cc:205] Tried to move back new op lower bound from 7317481123999719424 to 7317481123589427200. Current Snapshot: MvccSnapshot[applied={T|T < 7317481123999719424}]
I20260812 00:26:55.088696 12417 catalog_manager.cc:1347] Generated new cluster ID: 538395bfd5384f14bf8b5082cd25fd60
I20260812 00:26:55.088827 12417 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:26:55.101521 12445 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 00:26:55.109625 12296 master_runner.cc:186] Error getting master registration for 127.18.163.253:38329: OK, instance_id { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" instance_seqno: 1786494414201896 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:26:55.146353 12296 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:26:55.147938 12424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 966d764598604f5b8458848ba0aaee68. Latest consensus state: current_term: 1 leader_uuid: "966d764598604f5b8458848ba0aaee68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } } }
I20260812 00:26:55.148305 12424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:26:55.149241 12443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "966d764598604f5b8458848ba0aaee68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } } }
I20260812 00:26:55.149715 12443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:26:55.160394 12388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "966d764598604f5b8458848ba0aaee68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966d764598604f5b8458848ba0aaee68" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 44487 } } peers { permanent_uuid: "0f380060ea294e66b9db9588f99089c4" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 38329 } } peers { permanent_uuid: "3ee56bf94b35437c9513743c4426ce6b" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 38649 } } }
I20260812 00:26:55.160761 12388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68 [sys.catalog]: This master's current role is: LEADER
I20260812 00:26:55.162134 12417 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:26:55.164155 12417 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:26:55.181505 12453 catalog_manager.cc:1259] Loaded cluster ID: 538395bfd5384f14bf8b5082cd25fd60
I20260812 00:26:55.181748 12453 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4: loading cluster ID for follower catalog manager: success
I20260812 00:26:55.188632 12417 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 966d764598604f5b8458848ba0aaee68: Generated new TSK 0
I20260812 00:26:55.189849 12417 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:26:55.210806 12453 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4: acquiring CA information for follower catalog manager: success
I20260812 00:26:55.214200 12453 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0f380060ea294e66b9db9588f99089c4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 00:26:55.306887 12385 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:26:55.303723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37220 (local address 127.18.163.254:44487)
0812 00:26:55.303985 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.304000 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.304457 (+ 457us) server_negotiation.cc:407] Connection header received
0812 00:26:55.304792 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.304799 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.304891 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.304973 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:55.306537 (+ 1564us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37220: BlockingRecv error: recv got EOF from 127.0.0.1:37220 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260812 00:26:55.309510 12293 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:26:55.304583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40712 (local address 127.18.163.253:38329)
0812 00:26:55.304787 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.304793 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.307651 (+ 2858us) server_negotiation.cc:407] Connection header received
0812 00:26:55.307948 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.307954 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.308043 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.308122 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:55.309254 (+ 1132us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40712: BlockingRecv error: recv got EOF from 127.0.0.1:40712 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260812 00:26:55.312986 12383 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:26:55.310942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48754 (local address 127.18.163.252:38649)
0812 00:26:55.311140 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.311149 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.311238 (+ 89us) server_negotiation.cc:407] Connection header received
0812 00:26:55.311420 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.311425 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.311511 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.311628 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:55.312719 (+ 1091us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48754: BlockingRecv error: recv got EOF from 127.0.0.1:48754 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 00:26:55.362731 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:55.355899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40716 (local address 127.18.163.253:38329)
0812 00:26:55.356146 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.356156 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.356759 (+ 603us) server_negotiation.cc:407] Connection header received
0812 00:26:55.357048 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.357052 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.357239 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.357427 (+ 188us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:55.357987 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.358800 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.360244 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.360729 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.360883 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:55.361435 (+ 552us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:55.362034 (+ 599us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:55.362226 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:55.362293 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 00:26:55.362385 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260812 00:26:55.373008 12383 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:26:55.370558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48768 (local address 127.18.163.252:38649)
0812 00:26:55.370806 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.370816 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.371382 (+ 566us) server_negotiation.cc:407] Connection header received
0812 00:26:55.371650 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.371655 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.371759 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.371881 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:55.372734 (+ 853us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48768: BlockingRecv error: recv got EOF from 127.0.0.1:48768 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 00:26:55.384053 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:55.377423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40720 (local address 127.18.163.253:38329)
0812 00:26:55.377744 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.377754 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.378416 (+ 662us) server_negotiation.cc:407] Connection header received
0812 00:26:55.378725 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.378730 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.378829 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.378954 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:55.379572 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.380526 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.382057 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.382569 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.382731 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:55.383181 (+ 450us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:55.383335 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:55.383442 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:55.383609 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 00:26:55.383707 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260812 00:26:55.395870 12383 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:26:55.391712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48778 (local address 127.18.163.252:38649)
0812 00:26:55.391961 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.391970 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.394231 (+ 2261us) server_negotiation.cc:407] Connection header received
0812 00:26:55.394473 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.394479 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.394584 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.394709 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:55.395575 (+ 866us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48778: BlockingRecv error: recv got EOF from 127.0.0.1:48778 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 00:26:55.407435 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:55.401288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40726 (local address 127.18.163.253:38329)
0812 00:26:55.401564 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.401574 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.402219 (+ 645us) server_negotiation.cc:407] Connection header received
0812 00:26:55.402465 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.402470 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.402541 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.402656 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:55.403123 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.403954 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.405366 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.405880 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.406023 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:55.406570 (+ 547us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:55.406696 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:55.406800 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:55.406986 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 00:26:55.407079 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
W20260812 00:26:55.416720 12383 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:26:55.414238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48790 (local address 127.18.163.252:38649)
0812 00:26:55.414472 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.414482 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.415156 (+ 674us) server_negotiation.cc:407] Connection header received
0812 00:26:55.415392 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.415398 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.415490 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.415608 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:55.416445 (+ 837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48790: BlockingRecv error: recv got EOF from 127.0.0.1:48790 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:26:55.430801 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:55.424080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40736 (local address 127.18.163.253:38329)
0812 00:26:55.424428 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.424437 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.425724 (+ 1287us) server_negotiation.cc:407] Connection header received
0812 00:26:55.425973 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.425980 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.426113 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.426238 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:55.426682 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.427446 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.428845 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.429331 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.429476 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:55.429984 (+ 508us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:55.430102 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:55.430226 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:55.430396 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 00:26:55.430487 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154}
W20260812 00:26:55.440620 12383 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:26:55.437459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48798 (local address 127.18.163.252:38649)
0812 00:26:55.437830 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.437839 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.439096 (+ 1257us) server_negotiation.cc:407] Connection header received
0812 00:26:55.439332 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.439340 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.439429 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.439549 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:55.440377 (+ 828us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48798: BlockingRecv error: recv got EOF from 127.0.0.1:48798 (error 108)
Metrics: {"server-negotiator.queue_time_us":217}
I20260812 00:26:55.459259 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:55.452721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40748 (local address 127.18.163.253:38329)
0812 00:26:55.452978 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.452988 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.453799 (+ 811us) server_negotiation.cc:407] Connection header received
0812 00:26:55.454049 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.454054 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.454205 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.454320 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:55.454858 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.455729 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.457139 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.457787 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.457929 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:55.458376 (+ 447us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:55.458512 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:55.458615 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:55.458792 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 00:26:55.458881 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260812 00:26:55.475876 12383 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:26:55.473247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48808 (local address 127.18.163.252:38649)
0812 00:26:55.473446 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.473452 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.474253 (+ 801us) server_negotiation.cc:407] Connection header received
0812 00:26:55.474492 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.474498 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.474603 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.474725 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:55.475550 (+ 825us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48808: BlockingRecv error: recv got EOF from 127.0.0.1:48808 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 00:26:55.502154 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:55.495301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40750 (local address 127.18.163.253:38329)
0812 00:26:55.495559 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.495569 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.496181 (+ 612us) server_negotiation.cc:407] Connection header received
0812 00:26:55.496458 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.496469 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.496597 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.496713 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:55.497184 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.498238 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.499722 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.500367 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.500564 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:55.501266 (+ 702us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:55.501378 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:55.501490 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:55.501724 (+ 234us) server_negotiation.cc:299] Negotiation successful
0812 00:26:55.501816 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260812 00:26:55.514386 12383 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:26:55.511859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48824 (local address 127.18.163.252:38649)
0812 00:26:55.512105 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.512115 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.512696 (+ 581us) server_negotiation.cc:407] Connection header received
0812 00:26:55.512979 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.512986 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.513081 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.513199 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:55.514142 (+ 943us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48824: BlockingRecv error: recv got EOF from 127.0.0.1:48824 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:26:55.558420 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:55.551882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40762 (local address 127.18.163.253:38329)
0812 00:26:55.552193 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.552204 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.552781 (+ 577us) server_negotiation.cc:407] Connection header received
0812 00:26:55.553042 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.553047 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.553128 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.553249 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:55.553830 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.554860 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.556298 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.556875 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.557037 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:55.557489 (+ 452us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:55.557668 (+ 179us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:55.557777 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:55.557941 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 00:26:55.558035 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260812 00:26:55.567420 12383 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:26:55.564834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48834 (local address 127.18.163.252:38649)
0812 00:26:55.565100 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.565106 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.565805 (+ 699us) server_negotiation.cc:407] Connection header received
0812 00:26:55.566052 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.566058 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.566184 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.566307 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:55.567159 (+ 852us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48834: BlockingRecv error: recv got EOF from 127.0.0.1:48834 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 00:26:55.646549 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:55.639884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40776 (local address 127.18.163.253:38329)
0812 00:26:55.640132 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.640139 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.640529 (+ 390us) server_negotiation.cc:407] Connection header received
0812 00:26:55.640723 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.640736 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.640845 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.640968 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:55.641413 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.642692 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.644156 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.644880 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.645040 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:55.645557 (+ 517us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:55.645765 (+ 208us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:55.645868 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:55.646124 (+ 256us) server_negotiation.cc:299] Negotiation successful
0812 00:26:55.646226 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
W20260812 00:26:55.656512 12383 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:26:55.653924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48842 (local address 127.18.163.252:38649)
0812 00:26:55.654189 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.654200 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.654822 (+ 622us) server_negotiation.cc:407] Connection header received
0812 00:26:55.655036 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.655040 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.655122 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.655213 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:55.656265 (+ 1052us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48842: BlockingRecv error: recv got EOF from 127.0.0.1:48842 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 00:26:55.793989 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:55.788510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40790 (local address 127.18.163.253:38329)
0812 00:26:55.788728 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.788733 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.789009 (+ 276us) server_negotiation.cc:407] Connection header received
0812 00:26:55.789187 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.789191 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.789273 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.789367 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:55.789902 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.790669 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.792325 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:55.792759 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:55.792859 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:55.793279 (+ 420us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:55.793407 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:55.793476 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:55.793662 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 00:26:55.793754 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
W20260812 00:26:55.802312 12383 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:26:55.800397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48848 (local address 127.18.163.252:38649)
0812 00:26:55.800579 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:55.800584 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:55.800950 (+ 366us) server_negotiation.cc:407] Connection header received
0812 00:26:55.801117 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:55.801121 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:55.801197 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:55.801295 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:55.802107 (+ 812us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48848: BlockingRecv error: recv got EOF from 127.0.0.1:48848 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 00:26:56.068360 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:56.063174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40792 (local address 127.18.163.253:38329)
0812 00:26:56.063436 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:56.063443 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:56.063641 (+ 198us) server_negotiation.cc:407] Connection header received
0812 00:26:56.063830 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:56.063834 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:56.063906 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:56.063988 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:56.064419 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:56.065237 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:56.066680 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:56.067134 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:56.067240 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:56.067613 (+ 373us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:56.067734 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:56.067803 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:56.067947 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 00:26:56.068017 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
W20260812 00:26:56.076995 12383 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:26:56.074877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48860 (local address 127.18.163.252:38649)
0812 00:26:56.075096 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:56.075104 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:56.075501 (+ 397us) server_negotiation.cc:407] Connection header received
0812 00:26:56.075734 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:56.075738 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:56.075817 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:56.075937 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:56.076814 (+ 877us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48860: BlockingRecv error: recv got EOF from 127.0.0.1:48860 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 00:26:56.107030 12445 catalog_manager.cc:1259] Loaded cluster ID: 538395bfd5384f14bf8b5082cd25fd60
I20260812 00:26:56.107163 12445 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b: loading cluster ID for follower catalog manager: success
I20260812 00:26:56.110203 12445 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b: acquiring CA information for follower catalog manager: success
I20260812 00:26:56.112489 12445 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3ee56bf94b35437c9513743c4426ce6b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:26:56.599561 12586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:56.593820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40796 (local address 127.18.163.253:38329)
0812 00:26:56.594342 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:56.594350 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:56.594573 (+ 223us) server_negotiation.cc:407] Connection header received
0812 00:26:56.594816 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:56.594821 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:56.594898 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:56.595006 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:56.595449 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:56.596271 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:56.597739 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:56.598160 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:56.598304 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:56.598755 (+ 451us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:56.598864 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:56.598964 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:56.599138 (+ 174us) server_negotiation.cc:299] Negotiation successful
0812 00:26:56.599226 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":268,"threads_started":1}
I20260812 00:26:56.612200 12592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:56.605890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48876 (local address 127.18.163.252:38649)
0812 00:26:56.606476 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:56.606482 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:56.606503 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:26:56.606711 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:56.606716 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:56.606876 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:56.607068 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:56.607518 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:56.608259 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:56.609700 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:56.610203 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:56.610355 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:56.610925 (+ 570us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:56.611491 (+ 566us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:56.611665 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:56.611808 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 00:26:56.611896 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":312,"threads_started":1}
I20260812 00:26:56.627193 12586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:56.620156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40802 (local address 127.18.163.253:38329)
0812 00:26:56.620358 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:56.620365 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:56.620623 (+ 258us) server_negotiation.cc:407] Connection header received
0812 00:26:56.621057 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:56.621064 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:56.621157 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:56.621212 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:56.622150 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:56.623188 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:56.624916 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:56.625667 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:56.625810 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:56.626359 (+ 549us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:56.626486 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:56.626597 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:56.626767 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 00:26:56.626859 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 00:26:56.628508 12592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:56.620856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48888 (local address 127.18.163.252:38649)
0812 00:26:56.621051 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:56.621056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:56.622435 (+ 1379us) server_negotiation.cc:407] Connection header received
0812 00:26:56.622567 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:56.622573 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:56.622680 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:56.622785 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:56.623268 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:56.624078 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:56.626043 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:56.626742 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:56.626875 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:56.627641 (+ 766us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:56.627810 (+ 169us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:56.627904 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:56.628130 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 00:26:56.628219 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 00:26:56.630402 12599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:56.619377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37230 (local address 127.18.163.254:44487)
0812 00:26:56.619898 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:56.619904 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:56.619990 (+ 86us) server_negotiation.cc:407] Connection header received
0812 00:26:56.620359 (+ 369us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:56.620365 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:56.620622 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:56.620839 (+ 217us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:26:56.621913 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:56.624473 (+ 2560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:56.626931 (+ 2458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:56.627627 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:56.627826 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:56.629177 (+ 1351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:26:56.629737 (+ 560us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:26:56.629869 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:56.629983 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 00:26:56.630082 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":264,"threads_started":1}
I20260812 00:26:56.640858 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 12130
I20260812 00:26:56.642664 12198 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:56.759596 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 12130
W20260812 00:26:56.786438 12320 connection.cc:535] server connection from 127.0.0.1:48718 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:26:56.787112 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 12214
I20260812 00:26:56.788277 12281 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:56.907984 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 12214
I20260812 00:26:56.934515 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 12296
I20260812 00:26:56.935808 12375 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:26:57.049702 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 12296
2026-08-12T00:26:57Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (6363 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:26:57 dist-test-slave-njxd krb5kdc[12608](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:26:57 dist-test-slave-njxd krb5kdc[12608](info): set up 2 sockets
Aug 12 00:26:57 dist-test-slave-njxd krb5kdc[12608](info): commencing operation
krb5kdc: starting...
W20260812 00:26:58.296533 19087 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.004s sys 0.061s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/test-user.keytab.
Aug 12 00:26:58 dist-test-slave-njxd krb5kdc[12608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494418, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:26:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:26:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.163.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
Entry for principal kudu/127.18.163.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab.
I20260812 00:26:58.713872 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:38481
--webserver_interface=127.18.163.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:44717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:38481,127.18.163.253:45739,127.18.163.252:40531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:26:59.093405 12625 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:26:59.093951 12625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:59.094082 12625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:59.094246 12625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:59.102178 12625 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:59.102339 12625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:59.102458 12625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:59.102556 12625 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:59.102661 12625 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:59.113552 12625 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:44717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:38481,127.18.163.253:45739,127.18.163.252:40531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.254.keytab
--principal=kudu/127.18.163.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.254:38481
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.163.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:59.115295 12625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:59.116904 12625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:59.130697 12630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:59.130657 12633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:59.130724 12631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:59.131611 12625 server_base.cc:1034] running on GCE node
I20260812 00:26:59.132562 12625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:59.134379 12625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:59.135666 12625 hybrid_clock.cc:648] HybridClock initialized: now 1786494419135576 us; error 65 us; skew 500 ppm
I20260812 00:26:59.136054 12625 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:59 dist-test-slave-njxd krb5kdc[12608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494419, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:59.139623 12625 init.cc:377] Logged in from keytab as kudu/127.18.163.254@KRBTEST.COM (short username kudu)
I20260812 00:26:59.141335 12625 webserver.cc:460] Webserver started at http://127.18.163.254:34345/ using document root <none> and password file <none>
I20260812 00:26:59.142241 12625 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:59.142392 12625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:59.142758 12625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:59.146268 12625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-0/data/instance:
uuid: "d36c0fa23e7147469896b5f4fe1b3f7a"
format_stamp: "Formatted at 2026-08-12 00:26:59 on dist-test-slave-njxd"
server_key: "2eda8a4c16155012e06666dc588df11e"
server_key_iv: "d1cba12a653cf1acc7226cedef36e1d8"
server_key_version: "encryptionkey@0"
I20260812 00:26:59.147275 12625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-0/wal/instance:
uuid: "d36c0fa23e7147469896b5f4fe1b3f7a"
format_stamp: "Formatted at 2026-08-12 00:26:59 on dist-test-slave-njxd"
server_key: "2eda8a4c16155012e06666dc588df11e"
server_key_iv: "d1cba12a653cf1acc7226cedef36e1d8"
server_key_version: "encryptionkey@0"
I20260812 00:26:59.153439 12625 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260812 00:26:59.157546 12642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:59.159201 12625 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:26:59.159440 12625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-0/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-0/wal
uuid: "d36c0fa23e7147469896b5f4fe1b3f7a"
format_stamp: "Formatted at 2026-08-12 00:26:59 on dist-test-slave-njxd"
server_key: "2eda8a4c16155012e06666dc588df11e"
server_key_iv: "d1cba12a653cf1acc7226cedef36e1d8"
server_key_version: "encryptionkey@0"
I20260812 00:26:59.159703 12625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:59.184881 12625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:59.189437 12625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:59.189810 12625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:59.210947 12625 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.254:38481
I20260812 00:26:59.210974 12703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.254:38481 every 8 connection(s)
I20260812 00:26:59.212576 12625 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-0/data/info.pb
I20260812 00:26:59.215389 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 12625
I20260812 00:26:59.215597 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-0/wal/instance
I20260812 00:26:59.216084 19087 external_mini_cluster.cc:1428] Setting key 04f0a0663c3f7a38ca4c4cf672a7db34
I20260812 00:26:59.217085 12704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:59.224501 12704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:26:59 dist-test-slave-njxd krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494419, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:26:59.253762 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.228279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:38481 (local address 127.0.0.1:45176)
0812 00:26:59.229364 (+ 1085us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.229427 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:59.232699 (+ 3272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:59.233888 (+ 1189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:59.233899 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:59.234650 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:59.235028 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:59.235048 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:59.236965 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:59.236969 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:59.238279 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:59.238294 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:59.239834 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:59.239839 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:59.240063 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:59.240817 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:26:59.240843 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:59.243994 (+ 3151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:59.249058 (+ 5064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:59.249071 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:59.249082 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:59.249530 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:59.250134 (+ 604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:59.250137 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:59.250140 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:59.250301 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:59.251496 (+ 1195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:59.251503 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:59.251757 (+ 254us) client_negotiation.cc:769] Sending connection context
0812 00:26:59.251994 (+ 237us) client_negotiation.cc:240] Negotiation successful
0812 00:26:59.252467 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"mutex_wait_us":65,"thread_start_us":440,"threads_started":1}
I20260812 00:26:59.253830 12707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.228279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45176 (local address 127.18.163.254:38481)
0812 00:26:59.230491 (+ 2212us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:59.230497 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:59.230549 (+ 52us) server_negotiation.cc:407] Connection header received
0812 00:26:59.233189 (+ 2640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:59.233196 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:59.233523 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:59.233803 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:59.235301 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:59.236782 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:59.238460 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:59.239561 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:59.239913 (+ 352us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:59.244301 (+ 4388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:59.244316 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:59.244338 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:59.244395 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:59.248846 (+ 4451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:59.249764 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:59.249776 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:59.249782 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:59.250010 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:59.250445 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:59.250454 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:59.250460 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:59.251300 (+ 840us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:59.251544 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:59.252253 (+ 709us) server_negotiation.cc:299] Negotiation successful
0812 00:26:59.252660 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":70,"server-negotiator.queue_time_us":1986,"spinlock_wait_cycles":27392,"thread_start_us":1719,"threads_started":1}
I20260812 00:26:59.257212 12704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:26:59.258491 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.258029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:45739 (local address 127.0.0.1:58920)
0812 00:26:59.258231 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.258356 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:45739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260812 00:26:59.258761 12643 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.163.253:45739: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.18.163.253@KRBTEST.COM; defaulting to no policy
I20260812 00:26:59.260488 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.260089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:45739 (local address 127.0.0.1:58926)
0812 00:26:59.260260 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.260339 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:45739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260812 00:26:59.260727 12704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.253:45739: Network error: Client connection negotiation failed: client connection to 127.18.163.253:45739: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.253.keytab.
Entry for principal kudu/127.18.163.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.253.keytab.
I20260812 00:26:59.308959 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.253:45739
--webserver_interface=127.18.163.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.253.keytab
--principal=kudu/127.18.163.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:44717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:38481,127.18.163.253:45739,127.18.163.252:40531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:26:59.310084 12704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } attempt: 1
I20260812 00:26:59.311465 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.310916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:45739 (local address 127.0.0.1:58938)
0812 00:26:59.311176 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.311310 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:45739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260812 00:26:59.312637 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.312250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:45739 (local address 127.0.0.1:58942)
0812 00:26:59.312421 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.312492 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:45739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260812 00:26:59.312834 12704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.253:45739: Network error: Client connection negotiation failed: client connection to 127.18.163.253:45739: connect: Connection refused (error 111)
I20260812 00:26:59.381111 12704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } attempt: 2
I20260812 00:26:59.382512 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.381982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:45739 (local address 127.0.0.1:58950)
0812 00:26:59.382264 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.382355 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:45739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260812 00:26:59.383592 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.383222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:45739 (local address 127.0.0.1:58966)
0812 00:26:59.383392 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.383459 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:45739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 00:26:59.383828 12704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.253:45739: Network error: Client connection negotiation failed: client connection to 127.18.163.253:45739: connect: Connection refused (error 111)
I20260812 00:26:59.475090 12704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } attempt: 3
I20260812 00:26:59.476455 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.475828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:45739 (local address 127.0.0.1:58976)
0812 00:26:59.476110 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.476254 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:45739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260812 00:26:59.477877 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.477264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:45739 (local address 127.0.0.1:58990)
0812 00:26:59.477475 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.477648 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:45739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260812 00:26:59.478176 12704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.253:45739: Network error: Client connection negotiation failed: client connection to 127.18.163.253:45739: connect: Connection refused (error 111)
I20260812 00:26:59.621515 12704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } attempt: 4
I20260812 00:26:59.623087 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.622378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:45739 (local address 127.0.0.1:59004)
0812 00:26:59.622770 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.622888 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:45739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214}
I20260812 00:26:59.624318 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.623832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:45739 (local address 127.0.0.1:59018)
0812 00:26:59.624023 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.624135 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.253:45739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 00:26:59.624542 12704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.253:45739: Network error: Client connection negotiation failed: client connection to 127.18.163.253:45739: connect: Connection refused (error 111)
W20260812 00:26:59.686820 12711 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:26:59.687208 12711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:26:59.687297 12711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:26:59.687382 12711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:26:59.695006 12711 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:26:59.695127 12711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:26:59.695188 12711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:26:59.695242 12711 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:26:59.695309 12711 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:26:59.705807 12711 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:44717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:38481,127.18.163.253:45739,127.18.163.252:40531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.253.keytab
--principal=kudu/127.18.163.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.253:45739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.163.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:26:59.707242 12711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:26:59.708657 12711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:26:59.721443 12716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:59.721560 12717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:26:59.721622 12720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:26:59.722426 12711 server_base.cc:1034] running on GCE node
I20260812 00:26:59.723358 12711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:26:59.725069 12711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:26:59.726363 12711 hybrid_clock.cc:648] HybridClock initialized: now 1786494419726280 us; error 56 us; skew 500 ppm
I20260812 00:26:59.726769 12711 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:26:59 dist-test-slave-njxd krb5kdc[12608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494419, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:26:59.730551 12711 init.cc:377] Logged in from keytab as kudu/127.18.163.253@KRBTEST.COM (short username kudu)
I20260812 00:26:59.732232 12711 webserver.cc:460] Webserver started at http://127.18.163.253:40001/ using document root <none> and password file <none>
I20260812 00:26:59.733038 12711 fs_manager.cc:359] Metadata directory not provided
I20260812 00:26:59.733186 12711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:26:59.733542 12711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:26:59.736913 12711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-1/data/instance:
uuid: "008fab16cb8d40668be2010c87902468"
format_stamp: "Formatted at 2026-08-12 00:26:59 on dist-test-slave-njxd"
server_key: "afc9e93c13d4c055a335f0934d366dd6"
server_key_iv: "da52778e4ff29ffa6e7fd52d85e4a410"
server_key_version: "encryptionkey@0"
I20260812 00:26:59.737960 12711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-1/wal/instance:
uuid: "008fab16cb8d40668be2010c87902468"
format_stamp: "Formatted at 2026-08-12 00:26:59 on dist-test-slave-njxd"
server_key: "afc9e93c13d4c055a335f0934d366dd6"
server_key_iv: "da52778e4ff29ffa6e7fd52d85e4a410"
server_key_version: "encryptionkey@0"
I20260812 00:26:59.744107 12711 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:26:59.748198 12727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:26:59.749990 12711 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:26:59.750232 12711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-1/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-1/wal
uuid: "008fab16cb8d40668be2010c87902468"
format_stamp: "Formatted at 2026-08-12 00:26:59 on dist-test-slave-njxd"
server_key: "afc9e93c13d4c055a335f0934d366dd6"
server_key_iv: "da52778e4ff29ffa6e7fd52d85e4a410"
server_key_version: "encryptionkey@0"
I20260812 00:26:59.750510 12711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:26:59.767494 12711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:26:59.772138 12711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:26:59.772455 12711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:26:59.793318 12711 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.253:45739
I20260812 00:26:59.793340 12788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.253:45739 every 8 connection(s)
I20260812 00:26:59.794953 12711 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-1/data/info.pb
I20260812 00:26:59.799072 12789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:26:59.800635 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 12711
I20260812 00:26:59.800863 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-1/wal/instance
I20260812 00:26:59.801342 19087 external_mini_cluster.cc:1428] Setting key 85e3c31639feea7f891fdab9671c47fc
I20260812 00:26:59.806506 12789 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:26:59 dist-test-slave-njxd krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494419, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.253@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:26:59.831805 12791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.809515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45190 (local address 127.18.163.254:38481)
0812 00:26:59.810149 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:59.810158 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:59.811293 (+ 1135us) server_negotiation.cc:407] Connection header received
0812 00:26:59.813431 (+ 2138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:59.813440 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:59.813549 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:59.813712 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:59.815524 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:59.816701 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:59.818449 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:59.819197 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:59.819316 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:59.824493 (+ 5177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:59.824500 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:59.824503 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:59.824558 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:59.827933 (+ 3375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:59.829136 (+ 1203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:59.829140 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:59.829142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:59.829273 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:59.829850 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:59.829854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:59.829856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:59.830185 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:59.830306 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:59.831336 (+ 1030us) server_negotiation.cc:299] Negotiation successful
0812 00:26:59.831523 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":276,"threads_started":1}
I20260812 00:26:59.833552 12792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.810148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:38481 (local address 127.0.0.1:45190)
0812 00:26:59.811055 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.811124 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:59.813082 (+ 1958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:59.813971 (+ 889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:59.813981 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:59.814637 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:59.815261 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:59.815281 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:59.816886 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:59.816890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:59.818271 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:59.818286 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:59.819485 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:59.819495 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:59.819834 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:59.820726 (+ 892us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:26:59.820771 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:59.824173 (+ 3402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:59.828147 (+ 3974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:59.828163 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:59.828190 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:59.828991 (+ 801us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:59.829395 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:59.829404 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:59.829410 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:59.829720 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:59.830341 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:59.830353 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:59.830894 (+ 541us) client_negotiation.cc:769] Sending connection context
0812 00:26:59.831239 (+ 345us) client_negotiation.cc:240] Negotiation successful
0812 00:26:59.831874 (+ 635us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":385,"threads_started":1}
I20260812 00:26:59.835677 12789 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.18.163.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.163.252@KRBTEST.COM" created.
Aug 12 00:26:59 dist-test-slave-njxd krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494419, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.253@KRBTEST.COM for kudu/127.18.163.253@KRBTEST.COM
I20260812 00:26:59.854349 12792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.836501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:45739 (local address 127.0.0.1:59024)
0812 00:26:59.836712 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.836729 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:59.836829 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:59.838148 (+ 1319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:59.838153 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:59.838757 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:59.838928 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:59.838937 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:59.840366 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:59.840372 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:59.841240 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:59.841253 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:59.842207 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:59.842213 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:59.842432 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:59.843105 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:26:59.843123 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:59.846448 (+ 3325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:59.851461 (+ 5013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:59.851469 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:59.851475 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:59.852022 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:59.852508 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:59.852515 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:59.852521 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:59.852716 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:59.853542 (+ 826us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:59.853549 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:59.853721 (+ 172us) client_negotiation.cc:769] Sending connection context
0812 00:26:59.853836 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 00:26:59.854063 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 00:26:59.855131 12795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.836818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59024 (local address 127.18.163.253:45739)
0812 00:26:59.837687 (+ 869us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:59.837694 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:59.837724 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:26:59.837775 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:59.837781 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:59.837987 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:59.838168 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:59.839122 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:59.840215 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:59.841388 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:59.842043 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:59.842181 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:59.846761 (+ 4580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:59.846784 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:59.846809 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:59.846872 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:59.851241 (+ 4369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:59.852185 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:59.852198 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:59.852204 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:59.852371 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:59.852834 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:59.852842 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:59.852847 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:59.853391 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:59.853653 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:59.854023 (+ 370us) server_negotiation.cc:299] Negotiation successful
0812 00:26:59.854335 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":466,"threads_started":1}
I20260812 00:26:59.857789 12789 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:26:59.858992 12792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.858500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56216)
0812 00:26:59.858681 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.858819 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260812 00:26:59.859242 12729 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
I20260812 00:26:59.860960 12792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.860587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56222)
0812 00:26:59.860765 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.860849 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260812 00:26:59.861189 12789 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:40531: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.163.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.252.keytab.
Entry for principal kudu/127.18.163.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.252.keytab.
I20260812 00:26:59.891091 19087 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0D7a9a/build/asan/bin/kudu
/tmp/dist-test-task0D7a9a/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.252:40531
--webserver_interface=127.18.163.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.252.keytab
--principal=kudu/127.18.163.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.163.212:44717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.163.254:38481,127.18.163.253:45739,127.18.163.252:40531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:26:59.910521 12789 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } attempt: 1
I20260812 00:26:59.911976 12792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.911440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56232)
0812 00:26:59.911668 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.911791 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260812 00:26:59.913166 12792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.912762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56234)
0812 00:26:59.912955 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.913037 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 00:26:59.913477 12789 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:40531: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
I20260812 00:26:59.923828 12704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } attempt: 5
Aug 12 00:26:59 dist-test-slave-njxd krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494419, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for kudu/127.18.163.253@KRBTEST.COM
I20260812 00:26:59.939512 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.924736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:45739 (local address 127.0.0.1:59034)
0812 00:26:59.924983 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.925007 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:26:59.925213 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:26:59.925747 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:26:59.925751 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:26:59.926161 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:26:59.926355 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:59.926363 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:59.927982 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:59.927986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:59.928871 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:26:59.928884 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:26:59.930116 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:26:59.930121 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:26:59.930304 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:59.931003 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:26:59.931022 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:26:59.933281 (+ 2259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:26:59.936667 (+ 3386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:59.936673 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:59.936679 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:59.937107 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:59.937571 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:26:59.937623 (+ 52us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:26:59.937627 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:26:59.937794 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:26:59.938416 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:26:59.938421 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:26:59.938591 (+ 170us) client_negotiation.cc:769] Sending connection context
0812 00:26:59.938759 (+ 168us) client_negotiation.cc:240] Negotiation successful
0812 00:26:59.939125 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260812 00:26:59.939510 12795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.924953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59034 (local address 127.18.163.253:45739)
0812 00:26:59.925224 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0812 00:26:59.925235 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:26:59.925265 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:26:59.925349 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:26:59.925356 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:26:59.925474 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:26:59.925643 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:26:59.926538 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:59.927810 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:59.929054 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:26:59.929939 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:26:59.930125 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:26:59.933534 (+ 3409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:26:59.933540 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:26:59.933544 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:26:59.933632 (+ 88us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:26:59.936446 (+ 2814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:59.937262 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:59.937268 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:59.937272 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:59.937422 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:26:59.937923 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:26:59.937929 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:26:59.937934 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:26:59.938258 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:26:59.938432 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 00:26:59.938871 (+ 439us) server_negotiation.cc:299] Negotiation successful
0812 00:26:59.939122 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 00:26:59.940712 12704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:26:59.941854 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.941376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56250)
0812 00:26:59.941551 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.941703 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 00:26:59.942821 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.942473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56258)
0812 00:26:59.942617 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.942719 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 00:26:59.943040 12704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:40531: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
I20260812 00:26:59.981734 12789 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } attempt: 2
I20260812 00:26:59.983112 12792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.982609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56260)
0812 00:26:59.982838 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.982937 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260812 00:26:59.984303 12792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.983964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56264)
0812 00:26:59.984096 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.984167 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 00:26:59.984589 12789 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:40531: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
I20260812 00:26:59.994338 12704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } attempt: 1
I20260812 00:26:59.995711 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.995202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56272)
0812 00:26:59.995415 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.995519 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260812 00:26:59.996837 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:26:59.996463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56288)
0812 00:26:59.996635 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:26:59.996718 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 00:26:59.997164 12704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:40531: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
I20260812 00:27:00.065412 12704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } attempt: 2
I20260812 00:27:00.066766 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.066213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56294)
0812 00:27:00.066454 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:00.066580 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260812 00:27:00.067915 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.067557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56298)
0812 00:27:00.067700 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:00.067788 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 00:27:00.068199 12704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:40531: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
I20260812 00:27:00.075846 12789 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } attempt: 3
I20260812 00:27:00.077215 12792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.076679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56310)
0812 00:27:00.076933 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:00.077035 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260812 00:27:00.078459 12792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.078018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56326)
0812 00:27:00.078252 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:00.078342 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
W20260812 00:27:00.078745 12789 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:40531: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
I20260812 00:27:00.174461 12704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } attempt: 3
I20260812 00:27:00.175803 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.175300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56328)
0812 00:27:00.175514 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:00.175612 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260812 00:27:00.177212 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.176871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56336)
0812 00:27:00.177031 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:00.177102 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260812 00:27:00.177515 12704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:40531: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
I20260812 00:27:00.221971 12789 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } attempt: 4
I20260812 00:27:00.223218 12792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.222701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56346)
0812 00:27:00.222955 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:00.223047 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260812 00:27:00.224388 12792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.224048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56356)
0812 00:27:00.224194 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:00.224272 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260812 00:27:00.224751 12789 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:40531: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
W20260812 00:27:00.278265 12799 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:27:00.278664 12799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:00.278801 12799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:00.278939 12799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:00.286801 12799 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:27:00.286906 12799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:00.287000 12799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:00.287111 12799 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:27:00.287220 12799 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:27:00.297856 12799 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.163.212:44717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.163.254:38481,127.18.163.253:45739,127.18.163.252:40531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/krb5kdc/kudu_127.18.163.252.keytab
--principal=kudu/127.18.163.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.163.252:40531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.163.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:00.299306 12799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:00.300777 12799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:00.313727 12806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:00.313645 12807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:00.313714 12809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:00.314900 12799 server_base.cc:1034] running on GCE node
I20260812 00:27:00.315896 12799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:00.317842 12799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:00.319099 12799 hybrid_clock.cc:648] HybridClock initialized: now 1786494420319029 us; error 45 us; skew 500 ppm
I20260812 00:27:00.319496 12799 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:00 dist-test-slave-njxd krb5kdc[12608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494420, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:00.323052 12799 init.cc:377] Logged in from keytab as kudu/127.18.163.252@KRBTEST.COM (short username kudu)
I20260812 00:27:00.324750 12799 webserver.cc:460] Webserver started at http://127.18.163.252:44781/ using document root <none> and password file <none>
I20260812 00:27:00.325515 12799 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:00.325678 12799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:00.326040 12799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:00.329344 12799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-2/data/instance:
uuid: "c3090b9a02f24ce79293cf64bdc55862"
format_stamp: "Formatted at 2026-08-12 00:27:00 on dist-test-slave-njxd"
server_key: "4c2438a194e0f5ab324b00b07c40fd9a"
server_key_iv: "fdcebe881f9ad9776bd788f6045bb74c"
server_key_version: "encryptionkey@0"
I20260812 00:27:00.330283 12799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-2/wal/instance:
uuid: "c3090b9a02f24ce79293cf64bdc55862"
format_stamp: "Formatted at 2026-08-12 00:27:00 on dist-test-slave-njxd"
server_key: "4c2438a194e0f5ab324b00b07c40fd9a"
server_key_iv: "fdcebe881f9ad9776bd788f6045bb74c"
server_key_version: "encryptionkey@0"
I20260812 00:27:00.336218 12799 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:27:00.340086 12818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:00.341564 12799 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:27:00.341867 12799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-2/data,/tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-2/wal
uuid: "c3090b9a02f24ce79293cf64bdc55862"
format_stamp: "Formatted at 2026-08-12 00:27:00 on dist-test-slave-njxd"
server_key: "4c2438a194e0f5ab324b00b07c40fd9a"
server_key_iv: "fdcebe881f9ad9776bd788f6045bb74c"
server_key_version: "encryptionkey@0"
I20260812 00:27:00.342155 12799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:00.354768 12704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } attempt: 4
I20260812 00:27:00.356089 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.355569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56366)
0812 00:27:00.355830 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:00.355925 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260812 00:27:00.357175 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.356798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56382)
0812 00:27:00.356954 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:00.357031 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 00:27:00.357379 12704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.163.252:40531: Network error: Client connection negotiation failed: client connection to 127.18.163.252:40531: connect: Connection refused (error 111)
I20260812 00:27:00.358340 12799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:00.363165 12799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:00.363543 12799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:00.383785 12799 rpc_server.cc:307] RPC server started. Bound to: 127.18.163.252:40531
I20260812 00:27:00.383811 12878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.163.252:40531 every 8 connection(s)
I20260812 00:27:00.385289 12799 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-2/data/info.pb
I20260812 00:27:00.389237 12879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:00.392990 19087 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0D7a9a/build/asan/bin/kudu as pid 12799
I20260812 00:27:00.393211 19087 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0D7a9a/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494024564100-19087-0/minicluster-data/master-2/wal/instance
I20260812 00:27:00.393810 19087 external_mini_cluster.cc:1428] Setting key 660e128bbecadf8118612a9a566ad7b0
I20260812 00:27:00.397775 12879 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:27:00 dist-test-slave-njxd krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494420, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.252@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
Aug 12 00:27:00 dist-test-slave-njxd krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494418, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.252@KRBTEST.COM
I20260812 00:27:00.425028 12884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.401639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45202 (local address 127.18.163.254:38481)
0812 00:27:00.406663 (+ 5024us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:00.406670 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:00.407954 (+ 1284us) server_negotiation.cc:407] Connection header received
0812 00:27:00.409101 (+ 1147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:00.409105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:00.409193 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:00.409295 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:00.410957 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.411808 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.413662 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.414226 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.414327 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:00.418514 (+ 4187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:00.418522 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:00.418533 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:00.418574 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:00.421445 (+ 2871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.422422 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.422426 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.422429 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.422567 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.423108 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.423113 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.423115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.423402 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:00.423570 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:00.424336 (+ 766us) server_negotiation.cc:299] Negotiation successful
0812 00:27:00.424575 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4831,"thread_start_us":4633,"threads_started":1}
I20260812 00:27:00.426188 12883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.401069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.254:38481 (local address 127.0.0.1:45202)
0812 00:27:00.407669 (+ 6600us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:00.407771 (+ 102us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:00.408795 (+ 1024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:00.409403 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:00.409410 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:00.410338 (+ 928us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:00.410738 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:00.410759 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.411990 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.411995 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:00.413465 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:00.413478 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.414462 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.414469 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:00.414765 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:00.415639 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:00.415664 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:00.418242 (+ 2578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:00.421630 (+ 3388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:00.421644 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:00.421664 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:00.422290 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:00.422704 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:00.422712 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:00.422716 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:00.422994 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:00.423548 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:00.423556 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:00.423941 (+ 385us) client_negotiation.cc:769] Sending connection context
0812 00:27:00.424236 (+ 295us) client_negotiation.cc:240] Negotiation successful
0812 00:27:00.424776 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6112,"spinlock_wait_cycles":20864,"thread_start_us":5850,"threads_started":1}
I20260812 00:27:00.426215 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.396397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56392 (local address 127.18.163.252:40531)
0812 00:27:00.406028 (+ 9631us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:00.406047 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:00.406110 (+ 63us) server_negotiation.cc:407] Connection header received
0812 00:27:00.408795 (+ 2685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:00.408830 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:00.409186 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:00.409410 (+ 224us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:00.411070 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.412509 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.413938 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.414728 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.414853 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:00.419454 (+ 4601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:00.419472 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:00.419486 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:00.419518 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:00.422875 (+ 3357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.423603 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.423611 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.423613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.423760 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.424174 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.424178 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.424180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.424543 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:00.424907 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:00.425232 (+ 325us) server_negotiation.cc:299] Negotiation successful
0812 00:27:00.425501 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":9375,"thread_start_us":9110,"threads_started":1}
I20260812 00:27:00.428117 12879 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:27:00 dist-test-slave-njxd krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494420, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.252@KRBTEST.COM for kudu/127.18.163.253@KRBTEST.COM
Aug 12 00:27:00 dist-test-slave-njxd krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494418, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.254@KRBTEST.COM
I20260812 00:27:00.443764 12883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.428868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.253:45739 (local address 127.0.0.1:59042)
0812 00:27:00.429100 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:00.429116 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:00.429233 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:00.429911 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:00.429918 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:00.430443 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:00.430677 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:00.430691 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.431756 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.431760 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:00.432939 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:00.432955 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.433794 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.433801 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:00.434010 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:00.434716 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:00.434740 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:00.437307 (+ 2567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:00.441046 (+ 3739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:00.441052 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:00.441056 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:00.441460 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:00.441948 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:00.441956 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:00.441964 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:00.442115 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:00.442703 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:00.442708 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:00.442890 (+ 182us) client_negotiation.cc:769] Sending connection context
0812 00:27:00.443046 (+ 156us) client_negotiation.cc:240] Negotiation successful
0812 00:27:00.443376 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141}
I20260812 00:27:00.443779 12795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.429126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59042 (local address 127.18.163.253:45739)
0812 00:27:00.429346 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:00.429354 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:00.429396 (+ 42us) server_negotiation.cc:407] Connection header received
0812 00:27:00.429462 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:00.429468 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:00.429571 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:00.429701 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:00.430850 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.431594 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.433102 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.433542 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.433707 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:00.437537 (+ 3830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:00.437542 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:00.437546 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:00.437672 (+ 126us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:00.440886 (+ 3214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.441652 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.441656 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.441658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.441809 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.442243 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.442254 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.442257 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.442552 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:00.442843 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:00.443155 (+ 312us) server_negotiation.cc:299] Negotiation successful
0812 00:27:00.443390 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 00:27:00.444981 12879 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:27:00.445986 12884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.429633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45204 (local address 127.18.163.254:38481)
0812 00:27:00.429791 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:00.429795 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:00.429810 (+ 15us) server_negotiation.cc:407] Connection header received
0812 00:27:00.429987 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:00.429991 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:00.430059 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:00.430136 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:00.431558 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.432305 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.433929 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.434478 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.434633 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:00.439791 (+ 5158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:00.439800 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:00.439808 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:00.439867 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:00.442653 (+ 2786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.443402 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.443413 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.443416 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.443551 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.444226 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.444232 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.444235 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.444609 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:00.444960 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:00.445296 (+ 336us) server_negotiation.cc:299] Negotiation successful
0812 00:27:00.445559 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Aug 12 00:27:00 dist-test-slave-njxd krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494420, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.252@KRBTEST.COM for kudu/127.18.163.252@KRBTEST.COM
Aug 12 00:27:00 dist-test-slave-njxd krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494418, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.163.253@KRBTEST.COM
I20260812 00:27:00.461086 12883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.445838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56408)
0812 00:27:00.446130 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:00.446149 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:00.446273 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:00.446590 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:00.446595 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:00.446948 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:00.447349 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:00.447362 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.448656 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.448663 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:00.450197 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:00.450210 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.451151 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.451155 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:00.451371 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:00.452010 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:00.452033 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:00.454790 (+ 2757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:00.458511 (+ 3721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:00.458516 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:00.458520 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:00.459072 (+ 552us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:00.459506 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:00.459510 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:00.459512 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:00.459640 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:00.460305 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:00.460308 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:00.460452 (+ 144us) client_negotiation.cc:769] Sending connection context
0812 00:27:00.460575 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 00:27:00.460808 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205}
I20260812 00:27:00.461403 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.445857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56408 (local address 127.18.163.252:40531)
0812 00:27:00.446018 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:00.446024 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:00.446227 (+ 203us) server_negotiation.cc:407] Connection header received
0812 00:27:00.446397 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:00.446402 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:00.446471 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:00.446570 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:00.447491 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.448521 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.450336 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.450986 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.451133 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:00.455024 (+ 3891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:00.455031 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:00.455036 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:00.455078 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:00.458348 (+ 3270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.459185 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.459191 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.459194 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.459393 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.459753 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.459761 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.459767 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.460175 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:00.460340 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:00.460729 (+ 389us) server_negotiation.cc:299] Negotiation successful
0812 00:27:00.461033 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:27:00.466171 12795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.447933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59054 (local address 127.18.163.253:45739)
0812 00:27:00.448129 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:00.448135 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:00.448155 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:27:00.448245 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:00.448250 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:00.448321 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:00.448416 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:00.450085 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.451177 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.452979 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.453497 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.453675 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:00.459077 (+ 5402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:00.459090 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:00.459093 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:00.459162 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:00.462778 (+ 3616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.463732 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.463736 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.463738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.463999 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.464488 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.464492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.464494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.464813 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:00.465109 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:00.465467 (+ 358us) server_negotiation.cc:299] Negotiation successful
0812 00:27:00.465793 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 00:27:00.467820 12879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862: Bootstrap starting.
I20260812 00:27:00.471486 19087 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:27:00.472127 12879 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:00.473522 12879 log.cc:824] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:00.476788 12879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862: No bootstrap required, opened a new log
I20260812 00:27:00.474946 12676 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45204
I20260812 00:27:00.484589 12879 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } }
I20260812 00:27:00.485018 12879 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3090b9a02f24ce79293cf64bdc55862, State: Initialized, Role: FOLLOWER
I20260812 00:27:00.485534 12879 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } }
I20260812 00:27:00.486683 12887 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } } }
I20260812 00:27:00.487099 12887 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:27:00.487751 12879 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 00:27:00.498030 12899 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:27:00.498193 12899 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:27:00.495970 12799 master_runner.cc:186] Error getting master registration for 127.18.163.254:38481: OK, instance_id { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" instance_seqno: 1786494419204870 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:27:00.507772 12799 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:27:00.523978 12789 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } attempt: 5
Aug 12 00:27:00 dist-test-slave-njxd krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494419, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.253@KRBTEST.COM for kudu/127.18.163.252@KRBTEST.COM
I20260812 00:27:00.539932 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.524991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56410 (local address 127.18.163.252:40531)
0812 00:27:00.525217 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:00.525223 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:00.525251 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:27:00.525322 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:00.525328 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:00.525421 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:00.525562 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:00.526670 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.527445 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.529242 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.529889 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.530043 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:00.533824 (+ 3781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:00.533829 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:00.533832 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:00.533872 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:00.536856 (+ 2984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.537646 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.537656 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.537658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.537796 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.538253 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.538259 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.538263 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.538674 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:00.538871 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:00.539257 (+ 386us) server_negotiation.cc:299] Negotiation successful
0812 00:27:00.539508 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 00:27:00.539915 12792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.524802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56410)
0812 00:27:00.525003 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:00.525027 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:00.525184 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:00.525629 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:00.525634 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:00.526222 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:00.526474 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:00.526488 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.527622 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.527629 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:00.529056 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:00.529076 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.530060 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.530066 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:00.530337 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:00.531031 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:00.531051 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:00.533540 (+ 2489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:00.537037 (+ 3497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:00.537043 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:00.537047 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:00.537465 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:00.537934 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:00.537940 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:00.537943 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:00.538136 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:00.538807 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:00.538813 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:00.538992 (+ 179us) client_negotiation.cc:769] Sending connection context
0812 00:27:00.539155 (+ 163us) client_negotiation.cc:240] Negotiation successful
0812 00:27:00.539508 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 00:27:00.546638 12789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468: Bootstrap starting.
I20260812 00:27:00.551148 12789 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:00.552656 12789 log.cc:824] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:00.556444 12789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468: No bootstrap required, opened a new log
I20260812 00:27:00.568185 12789 raft_consensus.cc:348] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } }
I20260812 00:27:00.568665 12789 raft_consensus.cc:729] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 008fab16cb8d40668be2010c87902468, State: Initialized, Role: FOLLOWER
I20260812 00:27:00.569231 12789 consensus_queue.cc:260] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } }
I20260812 00:27:00.570379 12903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } } }
I20260812 00:27:00.570848 12903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:27:00.571786 12789 sys_catalog.cc:564] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:27:00.581028 12711 master_runner.cc:186] Error getting master registration for 127.18.163.254:38481: OK, instance_id { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" instance_seqno: 1786494419204870 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
W20260812 00:27:00.592382 12914 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:27:00.592602 12914 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:27:00.592752 12711 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 00:27:00.616132 12825 tablet.cc:2369] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:27:00.634596 12704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } attempt: 5
Aug 12 00:27:00 dist-test-slave-njxd krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494419, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.163.254@KRBTEST.COM for kudu/127.18.163.252@KRBTEST.COM
I20260812 00:27:00.654058 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.635506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.163.252:40531 (local address 127.0.0.1:56412)
0812 00:27:00.635836 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:00.635858 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:00.635991 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:00.636422 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:00.636428 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:00.637015 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:00.637253 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:00.637269 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.638844 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.638851 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:00.640441 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:00.640479 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.641655 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.641663 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:00.641885 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:00.642753 (+ 868us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:00.642782 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:00.646088 (+ 3306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:00.650804 (+ 4716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:00.650812 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:00.650816 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:00.651403 (+ 587us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:00.651933 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:00.651938 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:00.651942 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:00.652131 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:00.652887 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:00.652892 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:00.653076 (+ 184us) client_negotiation.cc:769] Sending connection context
0812 00:27:00.653236 (+ 160us) client_negotiation.cc:240] Negotiation successful
0812 00:27:00.653565 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193}
I20260812 00:27:00.655325 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.635684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56412 (local address 127.18.163.252:40531)
0812 00:27:00.635949 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:00.635956 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:00.635980 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:27:00.636133 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:00.636138 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:00.636227 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:00.636363 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:00.637446 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.638657 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.640637 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.641406 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.641555 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:00.646380 (+ 4825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:00.646388 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:00.646394 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:00.646442 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:00.650572 (+ 4130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.651580 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.651586 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.651590 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.651784 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.652269 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.652274 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.652278 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.652646 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:00.652814 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:00.654464 (+ 1650us) server_negotiation.cc:299] Negotiation successful
0812 00:27:00.654866 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
I20260812 00:27:00.661947 12704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a: Bootstrap starting.
I20260812 00:27:00.666698 12704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:00.668200 12704 log.cc:824] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:00.673350 12704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a: No bootstrap required, opened a new log
I20260812 00:27:00.686100 12704 raft_consensus.cc:348] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } }
I20260812 00:27:00.686954 12704 raft_consensus.cc:729] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36c0fa23e7147469896b5f4fe1b3f7a, State: Initialized, Role: FOLLOWER
I20260812 00:27:00.687881 12704 consensus_queue.cc:260] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } }
I20260812 00:27:00.689533 12919 sys_catalog.cc:455] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } } }
I20260812 00:27:00.691720 12919 sys_catalog.cc:458] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:27:00.692076 12676 raft_consensus.cc:482] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 00:27:00.692281 12676 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [term 0 FOLLOWER]: Advancing to term 1
W20260812 00:27:00.693164 12651 tablet.cc:2369] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:27:00.695813 12676 raft_consensus.cc:504] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } }
I20260812 00:27:00.696231 12704 sys_catalog.cc:564] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:27:00.698429 12761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "008fab16cb8d40668be2010c87902468"
I20260812 00:27:00.699011 12761 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:00.703019 12761 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d36c0fa23e7147469896b5f4fe1b3f7a in term 1.
I20260812 00:27:00.703922 12643 leader_election.cc:302] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 008fab16cb8d40668be2010c87902468, d36c0fa23e7147469896b5f4fe1b3f7a; no voters:
I20260812 00:27:00.704443 12919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:00.705757 12851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c3090b9a02f24ce79293cf64bdc55862"
I20260812 00:27:00.706298 12851 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:00.710173 12851 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d36c0fa23e7147469896b5f4fe1b3f7a in term 1.
I20260812 00:27:00.711016 12676 leader_election.cc:288] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [CANDIDATE]: Term 1 election: Requested vote from peers 008fab16cb8d40668be2010c87902468 (127.18.163.253:45739), c3090b9a02f24ce79293cf64bdc55862 (127.18.163.252:40531)
I20260812 00:27:00.723145 12919 raft_consensus.cc:686] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [term 1 LEADER]: Becoming Leader. State: Replica: d36c0fa23e7147469896b5f4fe1b3f7a, State: Running, Role: LEADER
I20260812 00:27:00.724309 12919 consensus_queue.cc:237] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } }
I20260812 00:27:00.735126 12921 sys_catalog.cc:455] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d36c0fa23e7147469896b5f4fe1b3f7a. Latest consensus state: current_term: 1 leader_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } } }
I20260812 00:27:00.735764 12921 sys_catalog.cc:458] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:00.746145 12928 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:27:00.768474 12928 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260812 00:27:00.775434 12734 tablet.cc:2369] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:27:00.799662 12944 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 00:27:00.828042 12761 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468 [term 1 FOLLOWER]: Refusing update from remote peer d36c0fa23e7147469896b5f4fe1b3f7a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:00.828037 12851 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862 [term 1 FOLLOWER]: Refusing update from remote peer d36c0fa23e7147469896b5f4fe1b3f7a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:00.829483 12921 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:00.831153 12921 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:00.838478 12884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.750676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45216 (local address 127.18.163.254:38481)
0812 00:27:00.750898 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:00.750905 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:00.761661 (+ 10756us) server_negotiation.cc:407] Connection header received
0812 00:27:00.769114 (+ 7453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:00.769123 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:00.769216 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:00.769290 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:00.783991 (+ 14701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.785200 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.794905 (+ 9705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.795629 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.795761 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:00.818624 (+ 22863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:00.818634 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:00.818639 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:00.818710 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:00.822636 (+ 3926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.829044 (+ 6408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.829051 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.829055 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.829323 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.835577 (+ 6254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.835584 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.835588 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.836070 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:00.836370 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:00.837676 (+ 1306us) server_negotiation.cc:299] Negotiation successful
0812 00:27:00.838023 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 00:27:00.840801 12795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.762335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59060 (local address 127.18.163.253:45739)
0812 00:27:00.762598 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:00.762608 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:00.772118 (+ 9510us) server_negotiation.cc:407] Connection header received
0812 00:27:00.778838 (+ 6720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:00.778847 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:00.778950 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:00.779035 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:00.787280 (+ 8245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.788456 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.803663 (+ 15207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.804475 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.804626 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:00.829778 (+ 25152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:00.829788 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:00.829796 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:00.829851 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:00.834147 (+ 4296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.837723 (+ 3576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.837730 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.837733 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.837934 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.838867 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.838873 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.838876 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.839260 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:00.839563 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:00.840099 (+ 536us) server_negotiation.cc:299] Negotiation successful
0812 00:27:00.840400 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 00:27:00.852737 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:00.772678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56418 (local address 127.18.163.252:40531)
0812 00:27:00.772873 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:00.772879 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:00.778473 (+ 5594us) server_negotiation.cc:407] Connection header received
0812 00:27:00.781530 (+ 3057us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:00.781537 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:00.781664 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:00.781738 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:00.791597 (+ 9859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.792785 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.805902 (+ 13117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:00.806678 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:00.806832 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:00.837057 (+ 30225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:00.837065 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:00.837071 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:00.837135 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:00.847515 (+ 10380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.848644 (+ 1129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.848653 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.848656 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.848845 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:00.849406 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:00.849411 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:00.849414 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:00.850185 (+ 771us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:00.850490 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:00.851968 (+ 1478us) server_negotiation.cc:299] Negotiation successful
0812 00:27:00.852284 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:27:00.867141 12903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d36c0fa23e7147469896b5f4fe1b3f7a. Latest consensus state: current_term: 1 leader_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } } }
I20260812 00:27:00.867530 12903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:27:00.869817 12945 mvcc.cc:205] Tried to move back new op lower bound from 7317481147647135744 to 7317481147294461952. Current Snapshot: MvccSnapshot[applied={T|T < 7317481147647135744}]
I20260812 00:27:00.871884 12948 mvcc.cc:205] Tried to move back new op lower bound from 7317481147647135744 to 7317481147294461952. Current Snapshot: MvccSnapshot[applied={T|T < 7317481147647135744}]
I20260812 00:27:00.875523 12903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } } }
I20260812 00:27:00.875787 12903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:27:00.882261 12887 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d36c0fa23e7147469896b5f4fe1b3f7a. Latest consensus state: current_term: 1 leader_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } } }
I20260812 00:27:00.882642 12887 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:27:00.888917 12887 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } } }
I20260812 00:27:00.889236 12887 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:27:00.899382 12919 sys_catalog.cc:455] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } } }
I20260812 00:27:00.899811 12919 sys_catalog.cc:458] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:00.900265 12919 sys_catalog.cc:455] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36c0fa23e7147469896b5f4fe1b3f7a" member_type: VOTER last_known_addr { host: "127.18.163.254" port: 38481 } } peers { permanent_uuid: "008fab16cb8d40668be2010c87902468" member_type: VOTER last_known_addr { host: "127.18.163.253" port: 45739 } } peers { permanent_uuid: "c3090b9a02f24ce79293cf64bdc55862" member_type: VOTER last_known_addr { host: "127.18.163.252" port: 40531 } } }
I20260812 00:27:00.900554 12919 sys_catalog.cc:458] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:00.907693 12928 catalog_manager.cc:1347] Generated new cluster ID: bf4e1c9062a04e08914873b9b5ae734a
I20260812 00:27:00.907840 12928 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:27:00.942795 12928 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:27:00.945441 12928 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:27:00.977635 12928 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d36c0fa23e7147469896b5f4fe1b3f7a: Generated new TSK 0
I20260812 00:27:00.979032 12928 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:27:01.124945 12884 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:27:01.120973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45224 (local address 127.18.163.254:38481)
0812 00:27:01.121267 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:01.121277 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:01.121846 (+ 569us) server_negotiation.cc:407] Connection header received
0812 00:27:01.122199 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:01.122209 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:01.122330 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:01.122430 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:01.124564 (+ 2134us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45224: BlockingRecv error: recv got EOF from 127.0.0.1:45224 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260812 00:27:01.128139 12795 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:27:01.122769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59064 (local address 127.18.163.253:45739)
0812 00:27:01.123052 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:01.123060 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:01.125793 (+ 2733us) server_negotiation.cc:407] Connection header received
0812 00:27:01.126123 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:01.126133 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:01.126271 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:01.126368 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:01.127748 (+ 1380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59064: BlockingRecv error: recv got EOF from 127.0.0.1:59064 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260812 00:27:01.132050 12882 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:27:01.130219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56432 (local address 127.18.163.252:40531)
0812 00:27:01.130460 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:01.130466 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:01.130575 (+ 109us) server_negotiation.cc:407] Connection header received
0812 00:27:01.130773 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:01.130779 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:01.130861 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:01.130975 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:01.131868 (+ 893us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56432: BlockingRecv error: recv got EOF from 127.0.0.1:56432 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260812 00:27:01.138916 12795 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:27:01.136379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59080 (local address 127.18.163.253:45739)
0812 00:27:01.136617 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:01.136627 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:01.137179 (+ 552us) server_negotiation.cc:407] Connection header received
0812 00:27:01.137459 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:01.137465 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:01.137638 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:01.137771 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:01.138614 (+ 843us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59080: BlockingRecv error: recv got EOF from 127.0.0.1:59080 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260812 00:27:01.145670 12795 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:27:01.143342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59082 (local address 127.18.163.253:45739)
0812 00:27:01.143587 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:01.143596 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:01.144145 (+ 549us) server_negotiation.cc:407] Connection header received
0812 00:27:01.144377 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:01.144384 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:01.144470 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:01.144590 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:01.145389 (+ 799us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59082: BlockingRecv error: recv got EOF from 127.0.0.1:59082 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260812 00:27:01.153486 12795 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:27:01.151044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59084 (local address 127.18.163.253:45739)
0812 00:27:01.151314 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:01.151324 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:01.151943 (+ 619us) server_negotiation.cc:407] Connection header received
0812 00:27:01.152187 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:01.152193 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:01.152281 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:01.152405 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:01.153186 (+ 781us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59084: BlockingRecv error: recv got EOF from 127.0.0.1:59084 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260812 00:27:01.163982 12795 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:27:01.161265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59088 (local address 127.18.163.253:45739)
0812 00:27:01.161653 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:01.161664 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:01.162326 (+ 662us) server_negotiation.cc:407] Connection header received
0812 00:27:01.162582 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:01.162588 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:01.162699 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:01.162827 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:01.163691 (+ 864us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59088: BlockingRecv error: recv got EOF from 127.0.0.1:59088 (error 108)
Metrics: {"server-negotiator.queue_time_us":160}
W20260812 00:27:01.178179 12795 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:27:01.175743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59098 (local address 127.18.163.253:45739)
0812 00:27:01.175997 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:01.176008 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:01.176613 (+ 605us) server_negotiation.cc:407] Connection header received
0812 00:27:01.176853 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:01.176858 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:01.176946 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:01.177062 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:01.177921 (+ 859us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59098: BlockingRecv error: recv got EOF from 127.0.0.1:59098 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260812 00:27:01.200799 12795 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:27:01.198331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59108 (local address 127.18.163.253:45739)
0812 00:27:01.198572 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:01.198582 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:01.199214 (+ 632us) server_negotiation.cc:407] Connection header received
0812 00:27:01.199467 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:01.199471 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:01.199557 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:01.199731 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:01.200560 (+ 829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59108: BlockingRecv error: recv got EOF from 127.0.0.1:59108 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260812 00:27:01.239413 12795 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:27:01.237236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59124 (local address 127.18.163.253:45739)
0812 00:27:01.237469 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:01.237476 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:01.237862 (+ 386us) server_negotiation.cc:407] Connection header received
0812 00:27:01.238047 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:01.238057 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:01.238178 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:01.238313 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:01.239117 (+ 804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59124: BlockingRecv error: recv got EOF from 127.0.0.1:59124 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260812 00:27:01.328497 12795 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:27:01.326025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59134 (local address 127.18.163.253:45739)
0812 00:27:01.326291 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:01.326299 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:01.326908 (+ 609us) server_negotiation.cc:407] Connection header received
0812 00:27:01.327211 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:01.327215 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:01.327291 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:01.327407 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:01.328295 (+ 888us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59134: BlockingRecv error: recv got EOF from 127.0.0.1:59134 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260812 00:27:01.463083 12795 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:27:01.461034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41828 (local address 127.18.163.253:45739)
0812 00:27:01.461237 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:01.461241 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:01.461672 (+ 431us) server_negotiation.cc:407] Connection header received
0812 00:27:01.461850 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:01.461854 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:01.461931 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:01.462033 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:01.462810 (+ 777us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41828: BlockingRecv error: recv got EOF from 127.0.0.1:41828 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:27:01.500434 12899 catalog_manager.cc:1259] Loaded cluster ID: bf4e1c9062a04e08914873b9b5ae734a
I20260812 00:27:01.500582 12899 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862: loading cluster ID for follower catalog manager: success
I20260812 00:27:01.503247 12899 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862: acquiring CA information for follower catalog manager: success
I20260812 00:27:01.505213 12899 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c3090b9a02f24ce79293cf64bdc55862: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:27:01.595029 12914 catalog_manager.cc:1259] Loaded cluster ID: bf4e1c9062a04e08914873b9b5ae734a
I20260812 00:27:01.595170 12914 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468: loading cluster ID for follower catalog manager: success
I20260812 00:27:01.598232 12914 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468: acquiring CA information for follower catalog manager: success
I20260812 00:27:01.600448 12914 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 008fab16cb8d40668be2010c87902468: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:27:01.733035 12795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:01.727237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41840 (local address 127.18.163.253:45739)
0812 00:27:01.727502 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:01.727507 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:01.727650 (+ 143us) server_negotiation.cc:407] Connection header received
0812 00:27:01.727831 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:01.727835 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:01.727998 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:01.728108 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:01.728507 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:01.729212 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:01.730710 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:01.731131 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:01.731242 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:01.731787 (+ 545us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:01.732342 (+ 555us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:01.732489 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:01.732591 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 00:27:01.732683 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260812 00:27:01.745249 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:01.739444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37628 (local address 127.18.163.252:40531)
0812 00:27:01.739989 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:01.739994 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:01.740049 (+ 55us) server_negotiation.cc:407] Connection header received
0812 00:27:01.740270 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:01.740274 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:01.740435 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:01.740588 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:01.740968 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:01.741775 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:01.743098 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:01.743508 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:01.743615 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:01.744095 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:01.744605 (+ 510us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:01.744733 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:01.744817 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 00:27:01.744887 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":296,"threads_started":1}
I20260812 00:27:01.759502 12795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:01.752239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41852 (local address 127.18.163.253:45739)
0812 00:27:01.752444 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:01.752450 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:01.752786 (+ 336us) server_negotiation.cc:407] Connection header received
0812 00:27:01.753111 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:01.753118 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:01.753232 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:01.753309 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:01.754213 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:01.755428 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:01.757282 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:01.757967 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:01.758099 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:01.758622 (+ 523us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:01.758764 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:01.758836 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:01.759114 (+ 278us) server_negotiation.cc:299] Negotiation successful
0812 00:27:01.759205 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:27:01.759557 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:01.751481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47214 (local address 127.18.163.254:38481)
0812 00:27:01.752029 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:01.752037 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:01.752072 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:27:01.752427 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:01.752434 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:01.752674 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:01.752894 (+ 220us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:01.753761 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:01.754795 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:01.757073 (+ 2278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:01.757703 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:01.757837 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:01.758462 (+ 625us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:01.758944 (+ 482us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:01.759068 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:01.759194 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 00:27:01.759271 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":303,"threads_started":1}
I20260812 00:27:01.760110 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:01.752902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37642 (local address 127.18.163.252:40531)
0812 00:27:01.753089 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:01.753095 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:01.753793 (+ 698us) server_negotiation.cc:407] Connection header received
0812 00:27:01.754079 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:01.754085 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:01.754202 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:01.754296 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:01.754904 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:01.755839 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:01.757974 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:01.758599 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:01.758738 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:01.759192 (+ 454us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:01.759314 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:01.759381 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:01.759776 (+ 395us) server_negotiation.cc:299] Negotiation successful
0812 00:27:01.759852 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 00:27:01.768093 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 12625
I20260812 00:27:01.769263 12698 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:01.891407 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 12625
I20260812 00:27:01.918879 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 12711
I20260812 00:27:01.920148 12783 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:02.035497 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 12711
I20260812 00:27:02.063635 19087 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task0D7a9a/build/asan/bin/kudu pid 12799
I20260812 00:27:02.064898 12872 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:02.177289 19087 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0D7a9a/build/asan/bin/kudu with pid 12799
2026-08-12T00:27:02Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5124 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (11488 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (397579 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST